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To Lisa 


Foreword 


It is difficult to think of researching in psychology without mak- 
ing use of some sort of test or measuring instrument. The re- 
searches which appear not to have used any tests in the formal 
sense only take a different view of testing through logical coding 
of subject's response. For example, in experimental studies 
testings are often blended into the methods of investigation. 

It is one thing to use a test for psychological researches, 
making diagnosis, etc. and another thing altogether to research 
into the test itself. This second group of researches are essen- 
tially related to the basic technology of testing which is perhaps 
the simple definition of psychometrics. The present research 
report of Dr. Puhan is an example of such works in the area of 
testing. Readers hoping for simple answers to basic requirements 
of psychological tests are likely to feel disappointed with this 
book. It actually presents disturbing evidences that the psycho- 
logical tests may often measure very different things in different 
people thus suggesting psychometric non-invariance for those 
tests. It is like a goldsmith who feels lost on discovering that his 
weighing machine actually measures weight when selling but 
temperature while buying metal in the form of hot liquid. Of 
course this sort of possibility will be quickly detected in physi- 
cal measures. But Dr. Puhan’s report suggests that such possi- 
bilities may not be entirely ruled out in psychological tests 
because it is likely to go unnoticed. | | 

The concept of psychometric invariance is relatively new to 
the area of psychometrics. Taking any new step is often asso- 
ciated with some amount of risk. In researches, however, tak- 
ing a new step is likely to end up in significant gain to the 
area provided it is well designed and neat as the present one. 
The worth of any work is often judged through its overall 
implications to the area. The results of the assessment. of 
psychometric invariance of WAIS seems to have interesting 
implications for the areas such as test reliability and validity. It 
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has actually raised more questions than answering them. It 
is these questions which would perhaps make this publication 
popular particularly among researchers in psychology and other 
disciplines that use psychological tests. 

I do not work strictly in the area of testing and measure- 
ment. However, I often use tests as much as others do. On 
reading this manuscript Г feel convinced that Dr. Puhan is 
making a good point through his proposition of the assessment 
of stability of the meaning of tests which he calls psychometric 
invariance. Such an assessment is bound to make an impact in 
the area of testing and test technology. 


R. RATH 
Professor of Psychology 
Utkal University 


Preface 


Much of the contents of this book is directly drawn from the 
author's dissertation submitted to the Faculty and Graduate 
Studies, University of Manitoba, in partial fulfilment of the 
requirements for Ph.D. degree. This book hopes to introduce 
the concept of psychometric invariance to the readers through 
the simplest logic of theoretical and mathematical inferences. 
A new concept, when introduced to a branch of scientific dis- 
cipline, needs to be explained with common examples, related 
with the existing concepts, and elaborated with its full range of 
implications. The concept of psychometric invariance has been 
dealt here keeping these obligations in view. 

In chapter I the concept of psychometric invariance is de- 
fined as merely referring to the structural stability of a measur- 
ing instrument or simply a row in the Factor Matrix across any 
specified dimension against which it is intended to be used. The 
implications, usability, and overall stability of psychometric 
invariance in psychometrics have been traced through its rela- 
tions with other existing requirements of psychological tests, 
viz., reliability and validity. It is pointed out that the usefulness 
of psychometric invariance far exceeds those of traditional 
reliability and validity assessment of a test. In chapter IV it is 
proposed that reliability and validity assessments of any psy- 
chological test be replaced by psychometric invariance assess- 
ment. For psychometric invariance assessment simultaneously 
evaluates reliability and validity of а test in terms of its factor 
loading components. With regard to the implications of psy- 
chometric invariance to the technology of testing it is suggested 
that this kind of assessment examines whether or not a test 
perceived in the same manner (or measures the same behaviour- 
al traits) when given to subjects belonging to characteristically 
different groups for which it is meant to be used. 

The other objective of this book is to demonstrate the 
psychometric invariance requirements for a standard psychologi- 


х Preface 


cal test. Wechsler Adult Intelligence Scales (WAIS) were con- 
sidered fitting for the purpose because most of the test review- 
ers agree that it is one of the best psychological tests and has 
almost become a standard against which other adult scales are 
often validated. The critical descriptions for all the WAIS sub- 
scales, the description of the sample, and procedure appear in 
chapter II. The invariance analyses and their results are given 
in chapter ІП. The limitations of the study are mainly related 
to the sampling procedure and the inadequacies in factor match- 
ing procedure. These points and the issues arising therefrom 
have been elaborated and discussed in chapter IV. 

The author is deeply grateful to Dr. M.S. Aftanas for his 
guidance, supervision, and instigating ideas through discussions 
and to Dr. J.R. Royce for his valuable comments as external 
examiner. Most of these ideas and comments have been incor- 
porated in this book. Sincere thanks are also extended to Drs. 
L.J. Breen, A.W. Pressey, J.H. Whiteley, and A. Bowd for their 
comments throughout the development of this work. 

The author feels a great personal obligation to Dr. R. Rath 
for his foreword and for getting this book published on behalf 
of our department and to Dr. В.В. Chatterjee for his help and 
encouragement during the preparation of the book. 

Special acknowledgements are due to my wife, Gopa, for 


typing the manuscript, many related papers, and most of all for 
her continued understanding. 


Contents 


Foreword 


Prefaee 


п. 


Ш. 


INTRODUCTION 
Review of the Literature 
Development of Intelligence During Childhood 
Development of Intelligence During Adult Life-Span 
A Model of Test Variance 
A Model of Factor Variance 
Multivariate Developmental Studies of Intelligence 
The Assessment of Psychometric Invariance 
Reinterpretation of Previous Findings 


Statement of the Problem 


METHOD 
Subjects 
Procedure 
Descriptions of the Main Variables 
Wechsler Adult Intelligence Scales (WAIS) 
Descriptions of the Marker Variables 
Differential Aptitude Tests (DAT) 
Culture Fair Intelligence Tests (CFIT) Scale ІП 


The Preliminary Analyses 


RESULTS 
1. The Correlations 
2. Factor Solutions 


3. Communalities 


xii 


Contents 


4. Interpretation of Factors 
(a) 18-19 Age Group 
(b) 25-34 Age Group 
5. Factor Similarity Across the Groups 


6. Invariance Analyses 


IV. DISCUSSION 


V. SUMMARY 


REFERENCES 


APPENDICES 


A. 


Cross-Cultural Comparisons of the Factor Loading 
Patterns of WAIS and HOWIE subtests 


B. Developmental Comparisons of the Factor Loading 
Patterns of WAIS Information Subtest 
C. Developmental Comparisons of the Factor Loading 
Patterns of the WAIS Digit Span Subtest 
D. Comparison of the hs and the Reliability Estimates 
(га) of WAIS Subscales 
E. Description of the Tests Used in the Present Study 
F. Eigen Values Based on the Principal Component 
Solutions 
G. Mean and Standard Deviations of Different Scales 
for the 18-19 and 25.34 Age Groups 
H. Product-Moment Correlations of the Twenty-four 
Variables for the 18-19 Age Group 
1. Product-Moment Correlations of the Twenty-four 
Variables for the 25-34 Age Group 
J. Principal Component Factors for the 18-19 Age Group 
K. Principal Component Factors for the 25-34 Age Group 
INDEX 


Page 
41 
41 
47 
51 
51 


58 
78 
81 


89 


91 
91 
92 


92 
93 


96 
97 
98 


100 
102 
103 


105 


CHAPTER I 


Introduction 


Balinsky (1941 : 231) is perhaps the first to indicate that the fac- 
torial composition of psychological measures changes as a func- 
tion of age. This suggests that the same test, given to а person 
of a certain age, would measure different abilities or factors from 
those when given to a person of a different age. Since then 


ced investigators have suggested the possibility of changes in 
actorial composition of different measuring instruments parti- 


cularly in a developmental context (Aftanas, 1966; Anastasi, 
1961; Garrett, 1946; Jones, 1959: 721; Lienert & Crott, 
1964). It seems that these suggestions have been made to elabo- 

ted changes in factor 


rate the implications of the demonstra. 
factors) across age groups. 


structures (i.e., factor loadings of 
point of view the develop- 


However, from the measurement 
nts of a measure need to be 


en implicated in the studies on 
ss the age groups. After all, 


mental changes in factor conte’ 
investigated beyond what have be 
Changes in factor structures асго 
the stability or instability of the factor contents of a test 
across the age groups, for example, does not necessarily depend 
in, stability or instability of factor structures (Balinsky, 

1). 

Recently Aftanas (1971а) has proposed a measurement 
approach in which he calls upon investigators to examine the 
stability of factor composition of measuring instruments under 
conditions of change; one such condition being developmental. 
From the measurement point of view it is therefore important 
to demonstrate the stability of factor contents of a measuring 
Instrument in the developmental context before it is given to 
Persons of different age groups: If a certain test is found to 
have different factorial compositions across age groups it indi- 
cates that the nature of the test (in terms of what it measures) 
Changes in the developmental context. and therefore is an 
inappropriate measure in that context. 


2 Assessment of. Psychometric Invariance of the WAIS 


The subject-matter most researched within the area of 
measurement in the developmental context is the measurement 
of intelligence and WAIS subscales in particular. The present 
study therefore intends to evaluate the stability (invariance) of 
psychometric components of the WAIS subscales across two 
selected adult age groups. 


REVIEW OF THE LITERATURE 
Development of Intelligence During Childhood 


One of the earlier developmental studies of intelligence was that 
of Gesell (1928). He advocated a logarithmic function between 
age and intelligence, thus Suggesting a very rapid growth of 
intelligence particularly during the childhood period. A similar 
theory was formulated by Terman (1916) who assumed a linear 
(one-to-one) relationship between age and intelligence. Accord- 
ing to him, such a trend continues until the age between 16 and 
18 and then reaches its peak (maximum growth). On the other 
hand, Thorndike, Bregman, Cobb, and Woodyard (1927) pro- 
posed a “parabolic function" of intellectual growth. According 
to this theory, a child acquires about one-half of his adult 
mental growth by the age of three. The results of all these 
studies were contradicted by those of Thurstone and Ackerson 
(1929). They have found that intelligence grows rapidly during 
the first nine or ten years, passes through a period of almost no 
growth around age eleven, and then grows slowly until it reaches 
the peak at the age of eighteen. 

The reasons for differential findings relating to the develop- 
mental changes of intelligence are summarized by Goodenough 
(1954 : 477-478). She has attributed these differences mainly 
to the dissimilarities in test contents or statistical procedures 
used in deriving the developmental functions of intelligence or 
both. 

И appears that most of the initial studies concerning the 
development of intelligence were limited to the childhood period 
which only represents a part of the entire life-span. Perhaps the 
lack of adequate adult intelligence scales during the time was 


responsible for such incomplete descriptions of the develop- 
ment of intelligence. 


Introduction 
Development of Intelligence During Adult Life-Span 


1 construction of many adult intelligence scales, particularly 
hose of Wechsler (і.е., Wechsler-Bellevue Intelligence Scales 
and Wechsler Adult Intelligence Scales), seems to have created 
Wider opportunities for studies attempting to describe the 
developmental functions of intelligence for the entire life-span. 
Among these, Wechsler's (1958) results are considered to be 
Most representative by many critics (e.g., Bromley, 1966; 
Butcher, 1968; Guilford, 1967; Jones, 1959). 

Wechsler (1958: 199-213) has reported that intelligence 
based on the total score on the WAIS attains its growth peak 
at the age of twenty-five and starts declining after the age of 
thirty. The rate of decline after this age is almost linear up to 
the age of seventy-five. He has also compared the developmen- 
tal functions of his verbal and performance scales and found 
that the former showed less rapid decline than the latter. 
Wechsler (1958) has further reported that the scales showing the 
most rapid decline were the Digit Symbol, Picture Completion, 
Picture Arrangement, and Block Design and the scales showing 
the least rapid decline were the Information, Vocabulary, and 
Comprehension. Most of the cross-sectional studies on W-B I 
and WAIS seem to agree with Wechsler's results (Doppelt & 
Wallace, 1955: Corsini & Fassett, 1953; Fox & Витеп, 1949; 
Heston & Cannell, 1941; Riegel, 1958). On the other hand, 


Most of the longitudinal studies on the WAIS or related tests 
ntil at least early forties 


tend to show a general improvement и 
for performance scales and late sixties for verbal scales (Ваујеу, 
1955; Owens, 1966; Welford, 1958). 

The results of developmental studies of intelligence would 
seem to have questionable scientific significance because of some 
inherent methodological and theoretical problems. All these 
Studies have adopted either cross-sectional or longitudinal re- 
Search designs, the validity of which is repeatedly challenged 
(Baltes, 1968; Schaie, 1965; Schaie & Strother, 1968a, 1968b) 
and still under scrutiny (Schaie, 1970). In a cross-sectional 


design the investigator attempts t gather developmental 
interest and comparing 


formation by selecting age groups of int У 
he resultant dependent variables. But Schaie (1965) has objected 
to such a practice оп the basis that the observed results, in this 


о 
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case, might represent a confounding effect of age and cohort 
(generational) factors. In the longitudinal design, a single group 
of subjects are studied at different ages of interest. Here also 
the observed results are likely to represent a confounding effect 
of age and time of measurement (environmental change) factors 
(Schaie, 1965). 

The other difficulty with these studies (i.e., Bayley, 1955; 
Corsini & Fassett, 1953; Fox & Birren, 1949; Heston & Cannell, 
1941; Owens 1966; Wechsler, 1958) seems to be a theoretical 
one. According to Aftanas (1971b), all these studies are pri- 
marily oriented to describe the developmental changes of psy- 
chological construct(s) as supposedly measured by a single test 
and therefore reflect a “construct approach". In other words, a 
single test study, investigating the function of the WAIS com- 
prehension scale across age groups, is essentially concerned with 
the developmental function of the psychological ‘‘construct of 
comprehension”. However, from the measurement point of 
view, this approach is not informative because it is contrary to 
the basic model of a test variance. 


A Model of Test Variance 


According to Guilford (1948) the total variance of a test can be 
subdivided into the following additive component variances: 


1. A number of common factors (common in the sense that 
they appear in more than one measure). 

2. A possible specific factor (a factor that appears consistently 
in the same variable from time to time but not in other 
variables). 


3. Error variance. 


In order to understand the basic postulates of Guilford it is 
important to define the term “factor”. Factors are described as 
hypothetical constructs (Harman, 1960), or convenient classifi- 
catory conceptualizations (Anastasi, 1938) which are considered 
“teal” (Thurstone, 1947) in terms of individual’s functional 
manifestations. According to Royce (1963), factors basically 
represent theoretical or psychological constructs. He has also 
described them as dimensions, determinants, functional unities, 
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parameters, and taxonomic categories. The term “factor” has 
also been used to mean independent abilities such as Primary 
Mental Abilities (Thurstone, 1938) or “distinct ability factors" 
(French, Ekstrom & Price, 1963; Guilford, 1959, 1967). It 
should be pointed out that an ability by itself does not neces- 
sarily mean a factor unless it is considered to be (at least theo- 
retically) a unique, an independent, or a primary function. At 
the empirical level these factors are determined by factor ana- 
lysis which refers to a mathematical technique to reduce a given 
set of data to a simpler form without losing any information 
inherent in the original data (Harman, 1960). The final step of 
this data-reduction process is to obtain a Factor Matrix (see 
Table 1). 


TABLE 1: Factor Matrix* 


Factor 

1 2 г 
1 ап ais air 
2 21 a22 Gor 
у dji азо air 


Note ; The entries in the Factor Matrix (а) 
of test on factor r and express the ex 
tests and factors. 


*Puhan (1975). 


refer to the factor loadings 
tent of relationship between 


948), the total variance of a test 


According to Guilford (1 i : 
cally by the following equation. 


could be expressed mathemati 


6% = ад + а? ЛЕ Жағы аз, ar 5% zs e = 1.00! (1) 


in which 


ngs or definitions intact, some of the 
nalsources Were changed in order 
d most importantly to develop a 
among various estimates of a 


ІКееріпр the underlying тсапі 
notations which appeared іп the origi 
to make the equations comparable and 1 
single equation outlining the relationships 
test. 
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с; = the total variance of test j, 

a? — the proportion of variance contributed by r number of 
common factors (common in the sense that they appear 
in more than one measure) to test j, 

52 = the proportion of variance contributed by a specific factor 
(afactor that appears consistently in the same variable 
from time to time but not in the other variables) to test J, 
and 

е? == the proportion of variance in test / contributed by errors 
due to sampling, conditions of testing, changes within 
individuals, etc. 


Thurstone (1947) and Harman (1960) have defined the sum 
of the common variance as communality which could be 
expressed by the equation : 

hey = аза + аза +... + аза, (2) 
in which 


h?; = the communality estimate of test j. 


Guilford (1948) has further indicated that the proportion of 
non-error variance of a test or its reliability can be described 
by the equation: 


ry аза + аза +... + а, + 55 = 1 — е, (3) 
A relative description of all the ideas expressed in the 


preceding formulations could be summarized by a single 
equation : 


9*2 ар + а +... + аза + 55 = 1 — еу = гу ha) 
Equation 4 suggests the following facts: 
1. that more factors than one account for the total variance of 


a test, 


2. that communality represents a lower bound of the total 
variance and reliability estimate of a test, and 
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3. that in an ideal (error- and specific variance-free) situation, 
total variance, reliability, and communality of a test should 
be the same. 


A Model of Factor Variance 


It could be pointed out that a similar factor analytic model of 
a test variance could be used to describe the total variance of 
a factor differing only in intent (direction). For example, the 
contents of a factor variance could be viewed as constituting an 
additive function of several tests as expressed by the equation: 


gh, = Ayr + Фу +... + аз, + 6 = еу, (5) 
in which 
c*, — the total variance of a factor r, 


а’, = the proportion of variance contributed by / number of 


tests, 4 1 
e? = the proportion of error variance (in 
associated with analytical techniques), and 


ev, — eigen value of factor г. 


this case errors 


The approach presented in eq. 5 has in fact served as the 
25 (1970) model for developmental studies. 


basis for Nesselroade's e 
Following this approach, studies have attempted to examine the 


stability of the structure of a psychological factor down the 
column in a Factor Matrix (i.e, бе бар: + > aj, in Table 1) for 
various developmental, cultural, or clinical groups (Puhan, 
19752). This approach is also indicative In à vast number of 
multivariate studies on Wechsler's adult scales ш ded 
tal, behavioural, and cultural contexts Ды i n y, дщ 
Berger, Bernstein, Klein & Lucas, 1964; Birr 2; 


i 1961; Puhan, 1978а; O'Neil, 
& Berkowitz, 1964; Maxwell, Mie 196; Мена 


1962; Radeliffe, 1966; Riegel & ? i 

Sprague perm 1966; Weiner, 1964; ied ea 
i a 

& Fields, 1970) most of whic SE 

Te i Of, e dern ater 

Structures of Wechsler's sc 

tion in the past decades. 
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Multivariate Developmental Studies of Intelligence 


Balinsky's (1941) study was the first multivariate investigation 
of the development of intelligence using one of the Wechsler's 
scales (1.е., W-B I). Obtaining all his data from the standardi- 
zation sample, he has factor analysed the correlation matrices 
for six age groups (ће., 9, 12, 15, 25-29, 35-44 & 50-59). He 
has then compared the factor structures for these groups and 
found an increase in the number of factors extracted between 9 
and 25-29, followed by a decrease in the 35-44 and 50-59 age 
groups. On the basis of his findings, Balinsky has suggested 
that there is a “tendency toward greater specification" from 
age 9 to age 25-29 and thereafter an apparent reorganization 
to the complexity which he has described as "flexible". 

The findings of Balinsky have provided supporting evidence 
for the differentiation theory of Garrett (1946). According to 
this theory, all psychological abilities which are found by factor 
analysis develop through a differentiation process that starts 
from a single, general (g) intellectual ability (Spearman, 1904, 
1927) in early childhood. Based on the theoretical formulations 
of Garrett and the‘empirical findings of Balinsky, several studies 
have attempted to evaluate the changing nature of the factor 
Structures of Wechsler's scales in a developmental context. 

Cohen (1957), using a portion of the WAIS standardization 
data (Wechsler, 1955; Doppelt & Wallace, 1955), has factor 
analysed the WAIS subscores for four adult age groups (i.e., 
18-19, 25-34, 45-54 & 60-75--) and found three major factors, 
i.e., Verbal Comprehension, Perceptual Organization, and 
Memory. Based on his results, Cohen has Suggested that the 
development of intellectual factors is essentially invariant 
throughout the life-span with the exception of the 60-75 -- age 
group. For this group the memory factor has been distributed 
Over several tests along with Arithmetic and Digit Span. In 
addition, Cohen has noted a strong general factor operating 
for all the age groups he has studied which has contradicted the 
differentiation hypothesis (Garrett, 1946) and its earlier esta- 
blished cvidence (Balinsky, 1941). 

Using different factor analytic techniques, Berger ег al. 
(1964) have reanalysed Cohen's data. One of the basic purpos- 
ез of this study was to gather information on age-functional 
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changes of the WAIS factors in the developmental context. The 
investigators have obtained unadjusted correlation coefficients 
(Burt, 1941 : 343) for all possible age pairs and reported uni- 
formity in the Verbal Comprehension and Perceptual Organiza- 
tion factor patterns across the age groups. However, the third 
factor (i.e., Memory) was found only in the 25-34 and 45-54 
age groups and not in the 18-19 and 60-75-r age groups. 

The overall findings of Berger et al. (1964) and Cohen 
(1957) were replicated on brain damaged (Reed & Fitzhugh, 
1967) and normal (Savage & Bolton, 1968) subjects. But a sub- 
sequent reanalysis (i.e., Radcliffe, 1966) of Cohen's data has 
suggested that the WAIS factor structures become increasingly 
complex as a function of chronological age (e.g., two, three, 
and five factors for Cohen's first, second, and third age groups). 
This study has provided strong support for the differentiation 
hypothesis. А somewhat modified version of the differentiation 
hypothesis has been proposed by Green and Berkowitz (1964) 
who have found a **general-to-specific-to-gener: ” function of 
the WAIS factor structures for various age groups ranging from 
under-29 to over-65. They, too, have found that a Memory 
factor was evident in all but the under-29 age groups which was 
earlier reported by Balinsky (1941). | 

A part of Cohen's (1957) results were also contradicted by 
Birren (1952) who found a different set of factors (ке, Verbal 
Comprehension, Closure, Rote Memory, and Induction) for 
W-B subscales. However, the results of Birren's study seem to 
have fewer implications in a developmental context because the 
data are based only on subjects between 60 and 74 years of 
age. A similar restricted sample was later studied by Riegel and 
Riegel (1962). The results of this study, though limited by the 
same drawback as that of Birren’s (1952), are significant for 
lications. The investigators have factor 


their cross-cultural imp! о 
analysed the German version of the WAIS (ie., Hamburg- 


Wechsler-Intelligenz-Tests fur Erwachsene : Riegel & Riegel, 
1959) and found no appreciable difference in factor structures for 
German and American cultures. However, reanalysing Cohen 8 
(1957) data, Riegel and Riegel (1962) have found age-functional 
differences in WAIS factor structure. А similar concern was 
expressed by Maxwell (1961) who found somewhat different 
factors (i.e, Verbal Comprehension, Space Performance, and 
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Education of Conceptual Relations) of WAIS subscales for 
60-64, 65-69, 70-74, and 75+ age groups. 

A review relating to the developmental changes of the WAIS 
factors has indicated that there have been some studies partly 
supporting the differentiation hypothesis (Balinsky, 1941; Rad- 
cliffe, 1966) whereas others have rejected it in part (Berger et al., 
1964; Birren, 1952; Cohen, 1952a, 1956, 1957; Maxwell, 1961) 
or entirely (Weiner, 1964). One apparent reason for such differ- 
ential findings seems to be different analytical techniques of 
data analysis used by the investigators. For example, in initial 
extractions of factor structures of the WAIS subscales Balinsky 
(1941), Berger et al. (1964), and Cohen (1952a, 1957) have used 
Thurstone’s (1947) centroid method whereas Maxwell (1961), 
Riegel & Riegel (1962), and Savage & Bolton (1968) have used 
Hotelling’s (1933) principal components solutions. The subse- 
quent rotations in these studies even differ greatly ranging from 
Thurstone’s (1947) graphic rotation in Maxwell’s (1961) to 
Carroll’s (1958) mathematically more complex oblique rotation 
in the Berger et al. (1964) study. In the midst of all these differ- 
ences in analytical procedures and subsequent results, however, 
one fact is clearly evident. The psychological factors measured 
by the W-B I or WAIS undergo considerable changes through- 
out the adult life-span. 

The changing nature of the intellectual factors seems to 
have reinforced the previous investigators to see whether or not 
the configuration of the basic factorial components of factors 


(patterns of factor loadings of columns in the Factor Matrix) 
remains stable or invariant for vari 


ance such as this is traditionally known as 
ance" (Thurstone, 


descriptions of a ше 
developmental context. 


THE ASSESSMENT OF PSYCHOMETRIC INVARIANCE 


In contrast to the factori 


al invariance, A la) has 
Proposed the concept of M 


PSychometric invariance which calls 
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upon investigators to see whether or not the configuration of 
the basic psychometric descriptions associated with a measure 
remains invariant under the conditions of change; some such 
conditions being cultural, behavioural, developmental, time of 
measurement, etc. According to Puhan (19752), psychometric 
invariance refers to the structural stability of a measuring in- 
strument or simply of a row in the Factor Matrix (i.e, ад, ад, 
jy, . . ., d; in Table 1) across any specified dimension (i.e., deve- 
lopmental, cultural or otherwise) against which it is intended to 
be used. It is further argued (Aftanas, 1971a; Puhan, 1975а, 
1975b, 19785) that such an evaluation represents a measurement 
approach because it is primarily concerned with the stability of 
a measuring instrument in terms of its variance components un- 
der the conditions of change. From a measurement point of 
view it would seem that a developmental comparison of per- 
formances on a certain test, for example, would be meaningful 
and valid if, and only if, the basic psychometric descriptions of 
that test could be demonstrated as invariant across the age 
groups that are being compared. Therefore the proposed psy- 
chometric invariance is basically concerned with the diagnostic 
utility or appropriateness of a measure in the context it is being 
used – developmental, cultural, etc. 

Тһе inherent relationship between the concept of psycho- 
metric invariance with the concepts of reliability and validity 
seems to be another reason why à psychometric invariance 
assessment is considered representing à measurement approach. 
According to Aftanas (1971a), if it could be demonstrated that 
the basic psychometric components ofatest remain the same 
in two successive administrations then the test could be con- 
sidered reliable. This would not only represent a special kind 
of test-retest reliability but also an evaluation of psychometric 
invariance across time. A special kind of parallel form of 
reliability could also be determined, if it could be demonstra- 
ted that the basic psychometric components of a test remain 
stable across similar or equivalent tests. This would perhaps re- 
present an assessment of psychometric іпуагіапсе across tests. 

On the other hand, if it could be demonstrated that the 
major sources of variability of a test are identified with the 
construct(s) that are being measured, then the test. could be con- 
sidered valid (Aftanas, 1971a) Furthermore, if it could be 
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demonstrated that the major sources of variability of a test are 
identified with the construct(s) that are being measured and 
consistently so across age, sex, cultural, behavioural groups, etc., 
then the test could be considered as psychometrically valid. 
This would represent an evaluation of psychometric invariance 
across groups. 


REINTERPRETATION OF PREVIOUS FINDINGS 


The lack of various kinds of psychometric invariance of WAIS 
seems to be suggested in many of the factor analytic studies we 
have discussed earlier. A comparison of the factor loading 
configurations of the Information scale from Riegel and Riegel’s 
(1962) findings would indicate that cultural psychometric in- 
variance was never achieved for this scale (see Appendix A). 
In a recent article, Puhan (1978c) has more fully elaborated the 
meaning of cultural Psychometric invariance and its impli- 
cations. 

The lack of psychometric invariance of WAIS Vocabulary 
and Arithmetic subscales has already been suggested in the 
developmental context (Aftanas, 1971b). Based on the re- 
arranged tables of Cohen (1957) and Berger et al, (1964), the 
present investigator has noted similar results particularly for 
WAIS Information (see Appendix B) and Digit Span (see Ap- 
pendix C) subscales, 

These examples Suggest that psychometric invariance of 
some of the WAIS subscales has never been demonstrated in a 
developmental context and they often tend to measure different 
things (factors) in different groups. 


STATEMENT OF THE PROBLEM 


A statement implying the lack of psychometric invariance of 
the WAIS would not be completely appropriate at this point 
because almost all the studies which suggest such a possibility 
(.е., Berger et. al., 1964; Cohen, 1957; Riegel & Riegel, 1962) 
are based partly or fully on the original standardization sample 
of the WAIS which was collected some time ago (Wechsler, 
1955; Doppelt & Wallace, 1955). Besides, these studies have 
failed to account for a satisfactory amount of reliable variance 
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(г) for different WAIS. For example, ап examination of A's 
in Berger et al. (1964) and Cohen's (1957) results revealed that 
all these values were less than .40 except for one (i.e., Vocabu- 
lary in Berger et al., 1964). Further, all these /?s were very 
low with respect to their corresponding reliability estimates (74) 
which are in the neighbourhood of .80 (see Appendix D). 
Ideally the Р? and the гу; of a test should be the same. In a 
practical situation, however, these two estimates of a test might 
differ only by a small margin owing to the contributions of the 
specific variances (8%) to the total variance of that test (see 
eq. 4). 

One way to approach this problem has already been indica- 
ted by Davis (1956). In Davis’ study, the W-B I subscales were 
factor analysed along with thirteen reference (related) variables 
for a single group. He then calculated the total percentage of 
variance (h?) of each of the W-B scales ascribable to the inter- 
pretable factors. An examination of these А°ѕ indicated that six 
of the eleven А5 were more than .40 which suggested that more 
than 40% of the total variance of each of these six W-B I scales 
was accounted for by different sources of variance (interpretable 
factors). Further, some of these 125 (i.e., for Information and 
Arithmetic subtests) were close to the reliability estimates of the 
corresponding scales (see Appendix D). Therefore, it was felt 
that more "reference tests" (Davis, 1956) or “marker vari- 
ables” (Cattell, 1952 : 238; Comrey, 1973: 190; Puhan, 19784, 
1978e) should be included and factor analysed along with the 
WAIS to raise the 155 of its subscales and thereby reduce the 
difference between the hè and ry of each of the WAIS. Only 
then would an evaluation of psychometric stability of a 
measure be more meaningful. Therefore, it was proposed that 
several reference or marker tests of known factor content (1.е., 
eight subscales of Differential Aptitude Tests, four subscales of 
Culture Fair Intelligence Tests, and Advanced Progressive 
Matrices) be included in the present investigation to assess the 
psychometric invariance of the WAIS subscales. 

The purpose of the present study was, therefore, to assess the 
psychometric invariance of the WAIS subscales in a develop- 
mental context under the conditions that should lead to a greater 
proportion of accountable variance for the subscales. Such an 
assessment was considered important in determining the 
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diagnostic utility or appropriateness of the WAIS subscales 
across adult age groups. 


The selection of the WAIS for the present study was based 
on its merits as a valid indicant of adult intelligence, its 
efficiency as a diagnostic instrument for certain pathological 
cases, and its overwhelming popularity among test users. 
Besides, the WAIS is not only considered as “ће best test of 
adult intelligence" (Burstein, 1972; Lyman, 1972) but it has 
also become а “standard’’ against which other adult tests are 
often compared (Bayley, 1959; Guertin, 1959). Therefore, the 
assessment of psychometric invariance of the WAIS would 
perhaps benefit a vast number of users - those who administer 
it and those who refer to it as a standard. 


CHAPTER 11 


Method 


It has been said in the preceding chapter that the present study is 
based on a measurement approach in that it intends to find out 
whether or not the meaning of a certain measuring instrument 
remains the same in а developmental context. Many investi- 
gators (Balinsky, 1941; Baltes, 1968; Nesselroade, 1970) have 
argued for significant structural changes associated with age. № 
is, therefore, very unlikely that psychometric invariance of the 
WAIS would exist across the entire life-span. Under this situa- 
tion the best approach would be to demonstrate the boundary 
conditions (e.g., certain age or cultural groups) of psychometric 
invariance. Thus, a most appropriate and informative study of 
psychometric invariance of the WAIS in a developmental con- 
text should investigate all possible adult age groups to deter- 
mine these boundary conditions. As a starting point, therefore, 
the present study included only two аге groups (viz., 18-19 and 
25-33) for which the lack of psychometric stability of some of 
the WAIS subscales was indicated in Berger ef al. (1964) and 
Cohen's (1957) studies. It could, however, be pointed out that 
should the WAIS be found to be psychometrically stable or 
otherwise across the present age groups, а generalization implying 
the same to the entire adult life-span would not be necessarily 
warranted. Rather, the implications of the results of the present 
study would only be limited to the age groups under investi- 
gation. 

Furthermore, à cross-sectional design was considered to be 
most appropriate for the present study. As pointed out by 
Aftanas (1971b), the possible cohort-related errors in a Cross- 
sectional design (Schaie, 1965; Baltes, 1968) are only applicable 


to a construct-oriented study where developmental descriptions 
ofa psychological factor are of utmost concern. In contrast, 
the present study is based on a measurement approach where 
the basic concern is to 566 whether or not the meanings of 
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certain measuring instruments remain the same across the age 
groups at a given point in time. In terms of practical implica- 
tions, the results of such an assessment would indicate whether 
or not the instruments under investigation could be used to 


compare two or more individuals of different ages at a given 
point in time, 


SUBJECTS 


A total of 200 subjects (i.e., 100 in each group) were tested for 
the present study. АП the subjects of the 18-19 age group and 
50 of the 25-34 age group were drawn from introductory psy- 
chology classes of the University of Manitoba who participated 
in the study as a part of their course requirements, Forty sub- 
jects of the 25-34 age group were drawn from introductory 
psychology classes of the evening and summer school of the 
same university. These subjects participated in the present study 
in lieu of a term paper required by their respective courses. The 
remaining 10 subjects of the 25-34 age group were volunteers 
who participated in the study to get some general feedback with 
regard to their performance on various ability tests. All these 
volunteers were high school graduates. In each group the sub- 
jects were evenly divided with respect to sex. Also care was 
taken to avoid unequal distribution of subjects of different ages 
within the 25-34 age group. For example, there were 35 sub- 
jects in each of the age ranges of 25-27 and 28-30 and 30 sub- 
jects in the age range of 31-34. АП the subjects of the present 


study were Canadian citizens or had lived in Canada for at least 
ten years at the time of testing. 


PROCEDURE 


АП the subjects were tested on the Wechsler Adult Intelligence 
Scale (Wechsler, 1955), Differential Aptitude Tests (Bennett, 
Seashore & Wesman, 1966), Culture Fair Intelligence Tests 
(Cattell & Cattell, 1959), and Advanced Progressive Matrices 
(Raven, 1947). The details of the testing procedure are outlined 
in Table 2. 

In the begining of the first session, all the subjects were 
briefed about the general nature and objectives of the study. 
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TABLE 2 : Description of the Testing Procedure 


Testing Name of Test Testing 
Session Condition 
I WAIS (all the 11 subscales) Individual 
Il DAT (the first 4 subscales) Group of 10-15 
ш DAT (the last 4 subscales) Group of 10-15 
IV CFIT (all the 4 subscales) 
and PM-A Group of 6-10 


They were assured that their test results would not be shown 
to anybody or published individually. They were further told 
that with their permission the test results could be obtained by 
an authorized agency or a practitioner for the purpose of 
vocational or clinical evaluation. The volunteers of the 25-34 
age group were promised general feedback with regard to 


their performance on the tests. 


All tests were administered in strict accordance with the 


instructions provided by the respective test manuals. The 
instructions for all group tests were read out while the subjects 
were asked to read them simultaneously with the experimenter. 
These instructions appeared on the front page of each of the 
test booklets. Wherever applicable, the examples of the test 
contents and various approaches to solve them were demons- 
trated on the blackboard. Testing Was carried out at the Uni- 
versity of Manitoba under a standardized set of testing condi- 
tions. For all subjects there was à minimum of’ five days’ 
interval between their successive testing sessions. In no case did 
the interval exceed three weeks. 

The following ate the brief descriptions of the measures 


used in the present study. The details of the nature of admi- 


nistration, time limit, scoring procedures, etc. are cited in 


Appendix E. 


DESCRIPTIONS OF THE MAIN VARIABLES 


Wechsler Adult Intelligence Scales (WAIS) 


revision and restandardiza- 
Bellevue (W-B) Intelligence 
fully selected stratified 


The WAIS (Wechsler, 1955) is a 
tion of Form I of the Wechsler- 
Scale. It was standardized on а саге 
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sample of 2,175 Americans representing different ages, sexes, 
occupations, geographical locations, rural-urban settings, edu- 
cational levels, and racial backgrounds. An additional sample 
of 475 subjects beyond 60 years of age was also included in 
the standardization of the WAIS (Doppelt & Wallace, 1955). 
The WAIS consists of six verbal (viz., Information, Com- 
prehension, Arithmetic, Digit Span, Similarities, and Vocabu- 
lary) апа five performance (viz, Digit Symbol, Picture 
Completion, Block Design, Picture Arrangement, and Object 


Assembly) subtests, The following are the brief descriptions of 
the nature of WAIS subscales, 


Test 1. Information (Inf) 


The Information subtest of the WAIS consists of items 
seeking a wide variety of information that an average adult 
with average Opportunity may be able to acquire for himself. 
For example, “What does rubber come from?". Some of the 
questions of the Information test were changed to suit the 
Canadian culture. For example, **What is the height of the 
average Canadian woman?", “How far is it from Montreal to 
Paris?", etc. This test contains 29 items which were selected 
from a much larger list on the basis of incidence of success and 
failure of various groups of individuals of known intelligence 
levels. An item was considered good if it demonstrated increas- 


ing frequency of success with high intellectual level (Wechsler, 
1958). 


Test 2. Comprehension ( Comp) 


The questions included in the Comprehensioi. scale are such 
that an average adult may have had an occasion to answer for 
himself at some time or heard being discussed by others. 
For example, “Why should we pay taxes?", According to 
Matarazzo (1972), success on this test seemingly depends on the 
possession of a certain amount of practical information and а 
general ability to evaluate one's past experience. 


Test 3. Arithmetic (Arith) 


The Arithmetic test consists of 14 items which require the 


| 
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subject to add, subtract, multiply, divide, or perform any two 
or more of these functions without any special aid. The com- 
putation skills needed to solve most of these problems are 
not beyond those taught in the grade school or what an average 
adult would acquire by himself in the course of day-to-day 
interactions with various persons or situations. 


Test 4. Similarities (Sim) 


The Similarities test of the WAIS consists of 13 items. In 
this test the subject is asked to tell in what way certain things 
or incidents or ideas are alike. For example, the subject is ask- 
ed such questions as “1л what way are an orange and a banana 
alike?". By answering such questions the subject supposedly 
manifests his ability (о perceive the analogies (common ele- 
ments) between two concepts (Wechsler, 1958). 


Test 5. Digit Span (D Sp) 


The Digit Span of the WAIS consists of a series of digits of 
different size. These series are orally presented to the subject 
who is required to repeat them either in the same order (Digit 
Forward) or in the reverse order (Digit Backward). Though 
each digit series has а parallel series, the second one is used 


only when the subject fails to pass the first. 


Test 6. Vocabulary (Уос) 


e WAIS consists of 40 words 


The Vocabulary Scale of th 
Пу presented to the subject. 


which are orally as well as visual ; 
The subject is required to express verbally the dictionary mean- 


ing of these words. In this test any recognized meaning is 
and there is no penalty for elegance of language. 
ect’s response is recommended by 
Wechsler on the basis of the quality of response. For example, 
if a subject defines a “slice’’ as “to cut" he receives one point. 
But if he defines it as “а piece", it earns him two points. 


acceptable, 
Differential scoring of subj 


Test 7. Digit Symbol (D Sy) 
The Digit Symbol of the WAIS consists of unfilled squares 
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for different digits and the subject is asked to fill them out by 
symbols representing digits which are provided. The subject is 
given a few practice trials to familiarize himself with the nature 
of the work and then is allowed to work for 90 seconds. 


Test 8. Picture Completion (PC) 


The Picture Completion test of the WAIS battery requires 
the subject to discover and name the missing part of incom- 
pletely drawn pictures. In this test the subject is presented with 
an incomplete picture (e.g., a man minus his left little finger or 
а car minus her door handles) and asked to indicate the most 
apparent missing part. Many studies (Cohen, 1956, 1957; Ber- 
ger et al., 1964: Green & Berkowitz, 1964) have indicated that 
the Picture Completion test measures individual’s basic per- 
ceptual and conceptual abilities so far as these are involved in 
the visual recognition and identification of familiar objects and 
forms. It is also pointed out by both Matarazzo (1972) and 
Wechsler (1958) that to be able to see the missing part, the sub- 
ject must appreciate that part in terms of its absolute impor- 


tance to the structural and/or functional nature of the whole 
picture. 


Test 9. Block Design (BD) 


The Block Design test is basically similar to that employed 
by the Kohs’ Test (1923), though its content has been modified 
to a considerable degree. The original Kohs’ Test included 
figures made up of red, yellow, blue, and white whereas the 
Block Design of the WAIS permits different patterns of red and 
white only. According to Wechsler (1958), this modification is 
necessary to eliminate the possible influence of the colour fac- 
tor, and to equate more nearly the amount of turning required 
by the subject for finding the faces of the blocks appropriate to 
the design. 

The Block Design test of the WAIS consists of 10 designs 
and nine blocks each of which is painted red, or white, or one- 
half red and one-half white. In this test the subject is given a 
certain number of blocks and is shown a pattern. The subject 


then assembles the blocks to make it identical to the pattern 
Shown to hike. пије 


— 
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Test 10. Picture Arrangement (PA) 


The Picture Arrangement test of the WAIS is very similar 
to the tests developed by DeCroly (1914), Yerkes (1921), and 
Cornell and Coxe (1934). The items of this test consist of a 
series of picture cards which are presented to the subject in a 
disarranged order. The subject then is asked to put these cards 
together in the right order so that they make a sensible story. 
There are eight sets of pictures in this test which were selected 
on the basis of interest of content, appealing quality to the 
subject, and ease of scoring. 

According to Wechsler (1958), the Picture Arrangement 
test of the WAIS is an effective measure of a subject’s ability 
to comprehend and coordinate a total situation. For this, the 
subject must understand the whole, and must get an idea of 
the story before he could arrange them in proper order. 
Matarazzo (1972) has pointed out that the understanding of 
these situations corresponds to what some authors (i.e., Schill, 
Kahn & Muehleman, 1968a, 1968b; and Jones, 1959: 719) 
have referred to as “‘social intelligence". 


Test 11. Object Assembly (OA) 


The Object Assembly test of the WAIS consists of four- 
figure form-boards which, when assembled, form different 
familiar objects. Some of the items of this test (i.e., Manikin 
and Profile) have been borrowed from the Pintner-Paterson 
Scale (Pintner & Paterson, 1917) and modified by the author. 
The other two items (1.е., Hand and Elephant) are entirely 
new. 

According to Wechsler, a subject could attempt to solve the 
problems of the Object Assembly scale in three different ways. 
First, the subject could have an immediate perception of the 
whole, accompanied by à critical understanding of the relation 
of the individual parts. A second type of response is that of 
rapid recognition of the whole but with imperfect understanding 
of the relations between the parts. Finally, it is also possible 
that the subject may begin with a complete failure to under- 
stand the total situation but arrives at the solution by trial-and- 


dem. LT 


2-7 /,(0 
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Тће WAIS manual (Wechsler, 1955) provides equivalent- 
form reliability coefficients for Digit Span and Digit Symbol 
and split-half reliability coefficients for the rest of the sub- 
scales. These subtest reliability coefficients ranged from a few 
in the .60 for Picture Arrangement and Object Assembly to as 
high as .96 for Vocabularly. 

The WAIS manual itself (Wechsler, 1955) contains no 
validity data though Wechsler's sübsequent publication (1958) 
covers several aspects of the validity of the WAIS. The reports 
of the validity data on the WAIS have been accumulating since 
it came to existence. A review of these would be unnecessary 
because most of them are reviewed elsewhere (Matarazzo, 
1972: ch.12). Based on the results of these studies, the vali- 
dity of the WAIS seems to be less questionable. Recently, 
Burstein (1972) and Lyman (1972) have insisted that the WAIS 
is still the “best test of adult intelligence". ш some earlier 
reviews, Bayley (1959) and Guertin (1959) have concluded that 


the “WAIS has become a standard against which other adult 
tests are often compared". 


DESCRIPTIONS OF THE MARKER VARIABLES 


One of the basic objectives of the present study was to mani- 
pulate a factor analytic situation which would provide greater 
accountable variance (155) for each of the WAIS subscales, In 
accordance with the theoretical formulations of Cattell (1952 : 
238), Comrey (1973 : 190) and the empirical findings of Davis 
(1956), many marker variables or related measures were searched 
to bring about such a condition. Finally, the subscales of the Dif- 
ferential Aptitude Tests, Advanced Progressive Matrices, and 
subscales of Culture Fair Intelligence Test were included as 
marker variables on the basis of their similarities and seemingly 
differences with the hypothesized factors of WAIS subscales. 


Differential Aptitude Tests (DAT) 


The DAT developed by Bennett, Seashore, and Wesman (1947) 
was considerably revised latel 


с У (Bennett, Seashore & Wes- 
man, 1966) to provide an integrated and well-standardized pro- 
cedure for Measuring the abilities of school students for the 


| 
| 
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purpose of vocational guidance. This test consists of eight sub- 
scales viz., Verbal Reasoning, Space Relations, Language 
Usage – Spelling, and Language Usage - Grammar, which are 
supposedly pure measures of different abilities. 

There have been conflicting reports with regard to the 
assumption of factor purity of the Differential Aptitude 
Tests. Merwin (1972) has indicated that the DAT consists of a 
series of “relatively independent” scales. However, on the basis 
of the results of a factor analytic study, Quereshi (1972) has 
questioned the assumption of factor purity of most of the DAT 
scales, He has found that except for Clerical Speed and Accu- 
гасу and Language Usage - Spelling, all the DAT scales are 
factorially complex (i.e. accounted for by more than one 
factor). He has also found а number of scales (i.e, Verbal 
Reasoning, Language Usage — Spelling, and Language Usage – 
Grammar) with equally high loadings on the same factor which 
indicated an undue redundancy of DAT measures. 


Test 12. Verbal Reasoning (VR) 


The Verbal Reasoning test is measure of ability to under- 
stand concepts framed in words and ability to generalize 
abstractly rather than simple vocabulary recognition. Therefore 
it includes many “analogy-type’” items which are drawn from a 
wide range of disciplines (1.е., 
Science, etc.). The following is а {ур 
included in this test. 


history, geography, literature, 
ical example of the items 


is to water as eat is to : 
1. Continue 2. Drink 3. Foot 4. Girl 
A. Drive B. Enemy C. Food D. Industry 


The subject is instructed to find a word from the first row for 


the first blank and a word from the second row for the second 


blank. The Verbal Reasoning 
ject’s understanding of variou 


test attempts to measure the sub- 
s concepts and verbal relations. 


Test 13. Space Relations (SR) 


The Space Relations test ofthe DAT is a measure of ones' 
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ability to deal with concrete materials through visualization 
and ability to imagine how an object would appear if rotated in 
а given way. The test also reflects the ability to manipulate 
things mentally in order to create а structure in one's mind from 
a plan. The test consists of forty patterns which can be folded 
into figures. For each pattern five figures are provided. The 
subject is asked to decide which of these five figures can be 


made out of the pattern shown. Diagram 1 is an example of the 
Space Relations Scale. 


DIAGRAM 1 


According to the authors of the test (Bennett et al., 1966), 


this test is important in evaluating a person's ability to think in 
spatial terms, 


Test 14. Clerical Speed and Accuracy (CSA ) 


The Clerical Speed and Accuracy test of the DAT battery is 
intended to measure one’s 


SAMPLE OF ANSWER 
SHEET 

1. l. X xv nx vx nv 
2. 1b 2. bl ld ыш bd 
3.ar au ur та ru 3. rà ur ar ти au 
4. 4. vw vu wy wu uw 
5% 5. wu wm mu mw um 


According to the test authors (Bennett et al., 


wm um mu wu mw 


1966), the items 
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of the CSA test measure the subjects speed of perception, 

Poner retention, and speed of response. There are two parts 
is test, each consisting of 100 items. Only the second 

of the CSA is scored. ў v 


Test 15. Language Usage – Spelling (LU – S) 


АП the words of the Language Usage - Spelling were selected 
from the original list of Gates’ (1937) Spelling Difficulties in 
3,876 Words. The words were further selected on the basis of 
their prominence in everyday vocabularly. The incorrect spell- 
ings included in this test are those which proved to be the most 
frequent errors by Gates (1937). The correctly spelled words 
were selected on the basis of the findings of a subsequent study 
(Wesman, 1946). The final test consists of 100 right and wrong 
words. The following are the first six items of the Language 


Usage - Spelling test. 


3. limited 5. comunity 


1. apointed 
6. variety 


2. commission 4. arival 


dicate whether the spelling of a parti- 


The subject is asked to in 
answer sheet. 


cular word is wrong or right on the 


Test 16. Language Usage – Grammar (LU - G) 


Language Usage test of the DAT 


The Grammar part of the 
divided into five parts. For exam- 


eo of 40 sentences, each 
ple: 


where/did you/stop at/on your trip/to Chicago 
(е; р 


А В 
the whole sentence and mark against 


The subject is asked to read 
g with respect to spelling, punctua- 


the parts he considers WTO. 
tion, and grammar. 


Test 17. Numerical Ability (NA) 


ale of the DAT is designed to 


The Numerical Ability 5С igned 
ding of numerical relationships, 


evaluate a subject's understan. 
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his facility in handling numerical concepts, and his ability to 
deal abstractly with quantitative materials. This test consists of 
40 problems of addition, subtraction, multiplication, division, 
Square root, cube root, and the like followed by five answers for 
each. The subject indicates his response in the answer sheet by 
blackening the space under the alternative he feels is correct. 


Test 18. Abstract Reasoning (AR) 


The Abstract Reasoning test of the DAT is designed as а 
non-verbal measure of reasoning ability. Each item of this test 
Tequires the subject to perceive an operating principle in chang- 
ing diagram Presented in a series and give evidence of such 
understanding by designating an answer diagram from among 
the six which should logically follow the fourth problem figure. 
Diagram 2 is an example of the kind of items used in this test. 


DIAGRAM 2 


ANS WEN УСПЕХ 
Г 


©] [e | = 
LJ Е bad 
= 4 лв 
According to Bennett et al. (1966), the Abstract Reasoning 


test involves the ability to perceive relationships in abstract 


figure patterns, generalization, and self-education of principles 
from non-language designs. 


Test 19. Mechanical Reasoning (MR) 


The Mechanical Reasoning test of the DAT is essentially a 
new form of Bennett’s Mechanical Comprehension Test. Each 
of the 68 items of this test Consists of a pictorially presented 


mechanical situation with a simple worded question. Diagram 3 
is an example of the t 


Уре of items included in the Mechanical 
Reasoning test. 


The latest edition of the DAT manual (Bennett ef al., 1966) 
provides split-half reliability coefficients for all the tests except 
Clerical Speed and Accur 


: е асу for which а parallel-form reliabi- 
lity coefficient was obtai 


ined, All these Teliability coefficients 
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DIAGRAM 3 


When the small gear on the left 
turns in the direction shown, whic! 
way will the big gear “X” turn 1 
(If it is not possible to know, 

mark C.) 


were found to be reasonably high ranging from .80s for Clerical 
Speed and Accuracy and Language Usage - Grammar to, 90s 
for Space Relations and Verbal Reasoning. 

The amount of validity data available on the DAT is consi- 
derable (Harris & Dole, 1956; Halsey, 1956; Doppelt, Seashore 
& Odgers, 1959; Stoughton, 1955). Most of these data are con- 
cerned with the predictive validity in terms of high school and 
college achievements. The fourth edition of the DAT manual 
summarizes a huge number of validity studies (Bennett et al., 
1966 : ch. 5). 

Ithas been pointed out earlier that the DAT scales were 
Selected for the present study primarily for their similarity with 
the WAIS. For example, Information, Comprehension, Simila- 
rities of the WAIS seem to be similar to Verbal Reasoning, 
Language Usage – Spelling, and Language Usage - Grammar of 
the DAT. Also Block Design, Picture Arrangement, and Object 
Assembly of the WAIS seem to be related to Spatial Relations 
and Mechanical Reasoning scales of the DAT. Finally, Digit 
Span and Arithmetic seem to have some degree of resemblance 
with Numerical Ability and Clerical Speed and Accuracy of the 
DAT. 


It is also important to note that the nature of some of the 


DAT scales could be related to frequently identified factors of 
the WAIS. For example, Verbal Reasoning of the tee 
to reflect a process similar to that of а Verbal exon Res 
factor of the WAIS. Mechanical Reasoning and E ja 2 
tions seem to measure а process similar to that of a ci al 
Organization factor of the WAIS. А Freedom ironi ЊЕ ад) 
bility process which has been repeatedly found in i T у 
1952а, 19526; Hover, 1950) seems indicative 1n the Languag 

Usage – Spelling scale of the DAT. 
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Test 20. Advanced Progressive Matrices (PM — A) 


The Advanced Progressive Matrices test was developed by 
Raven (1947) to measure Spearman’s (1904, 1927) general in- 
telligence ог ‘g’. The task consists of designs which require 


completion. In these tests the subject chooses one from among 


many designs that best fits the missing part of the question 
figure, Àn answer which fits may (a) complete a pattern, (b) 
complete an analogy, (c) systematically alter, (d) systematically 
resolve figures into parts. There are two sets of matrices in this 
test. The items of the first set are designed to introduce a per- 


son to the general nature of problems of the second test. The 
subject's total score in this test is his 
ponses in the second set. 

The manual for the Advanced Progressive Matrices (Raven, 
1947) reports reliability coefficients which range from .76 to .90. 
But it does not contain any reports on validity. However, re- 
viewing more than 70 validity studies Burke (1958) has con- 
cluded that the Progressive Matrices test is heavily loaded with 


a factor common to most intelligence tests (i.e., Spearman's 
fg). 


number of correct res- 


Culture Fair Intelligence Tests (CFIT) Scale Ш 


The Scale Ш of the Culture Fair Intelligence Test (Cattell & 
Cattell, 1959) is essentially a 


claims made for these scales ig 
on general ability and th: i i 
School achievements, 
environmental influen 
sists of four subscale: 
Conditions, 


Test 21. Series (Ser) 
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DIAGRAM 4 


The Series consists of 13 items all of which bear similar 
principles involved in the Abstract Reasoning test of the DAT. 


Test 22. Classification (СТ) 


The Classification test of the Culture Fair battery requires 
the subject to pick out a pair from among the five drawings 
that are different from the other three similar ones. This test 
consists of 14 items and is administered for four minutes. Dia- 
gram 5 is the first item included in the Classification test. 


DIAGRAM 5 


Test 23. Matrices (Mat) 


ale of the CFIT is very much similar to that 


The Matrices sc г 
Matrices. The only difference 


of Raven's (1947) Progressive 
between the two scales seems to be the number of alternate 


answers which are provided to the subject to choose from as the 
missing part of the main figures. Fach of the problems of the 
Matrices scale consists of six alternate answers compared to 
eight in the Advanced Progressive Matrices test. This test 
Consists of 13 items and is administered for three minutes. 
Diagram 6 is an example of items included in this scale. 


DIAGRAM 6 
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Test 24. Conditions (Cond) 


Each item of the conditions scale provides one problem 
figure accompanied by five answer figures. In a typical problem 
figure a dot is put in a particular place with respect to different 
geometrical figures and the subject is asked to find a figure 
from among the five given alternatives where he could possi- 
bly put a dot without altering the principles involved in the 
placement of the dot. This test consists of ten items and is 


administered for two and a half minutes. Diagram 7 is the first 
item included in this test. 


DIAGRAM 7 


Many studies intending to examine the validity of the CFIT 
test have appeared in the past (Bensburg & Soaln, 1955; 
Tilton, 1949; Rodd, 1958; Goossens, 1952). Reviewing most 
of these studies, Tannenbaus (1965) has concluded that the 
evidence of validity of the CFIT is “very impressive". However, 
Some investigators (ie., Xydias 1956; Anastasi & Cordova, 
1953) doubt the *'culture-fairness" quality of this scale. 

The subscales of the Culture Fair Intelligence Tests were 
included in the present study as marker variables due to their 
similarities with some of the WAIS performance scales. For 
example, Picture Completion, Block Design, Picture Arrange- 
ment, and Object Assembly seem to represent some degree of 


culture fairness because they have been repeatedly found 
measuring a Perceptual 


г Organizatlon factor which is relatively 
independent of cultural influences (Cohen, 19525; Berger et al., 
1964; Radcliffe, 1966). 


THE PRELIMINARY ANALYSES 


АП the analyses of the present study were based on the raw 
Scores of the twenty-four variables and were performed on the 
IBM 360/65 at the University of Manitoba Computre Centre. 
The programme involves а principal axes solution (Hotelling, 
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1933) with ones as the diagonal elements. It further rotates 
the principal axes solution to an unique Varimax analytic 
solution (Kaiser, 1958). 

Two separate analyses were performed for the 18-19 and 
25-34 age groups. This resulted in 24 principal component 
factors with a list of corresponding eigen values for both 
the groups which appear in Appendix F. Then the nature of 
major principal component factors of both the groups were 
grossly examined. It could be recalled that the basic objec- 
tive of the present study was to compare the factor load- 
ing patterns of У/А15 subscales across the 18-19 and 25-34 
age groups. Such comparisons would require equal number of 
similar factors for both the groups. It was, therefore, necessary 
to examine the eigen values and select one from each of the 
groups that would result not only in equal number of similar 
principal component factors but also meet closely the criteria 
of “positive generalizability” (Kaiser and Caffrey, 1965) and 
the ‘‘scree test" (Cattell, 1966). According to Kaiser and 
Caffrey an eigen value of 1.00 is arbitrarily considered a point 
corresponding to the criterion of positive generalizability. 
On the other hand, the scree test involves plotting all the eigen 
values against the factors and finding a point where the curve 
approaches a straight line which could be used as a cutting 
point to retain factors. Retaining factors beyond this point is 
considered unnecessary because when the curve begins to 
approach a straight line it would simply indicate correlations 
among specific orthogonals in the population and error of 
measurement; both of which are unimportant for the purpose 


of the interpretation of factors. 
Once the desired factors are rotated and interpreted, the 


most similar pairs of factors would be matched across the 
groups of the present study. Then Horn’s (1961) corrected 
version of pattern correlation coefficient (г) would be used to 
determine psychometric invariance of the WAIS. Pattern 
correlation coefficient Was considered to be the most appropriate 
because of its special implications (1.6., significant positive, in- 
significant, and significant negative) in the context of psycho- 
metric invariance assessment. These impli€ations would be more 


fully described in the next chapter. 


CHAPTER Ш 


Results 


The means and standard deviations for each variable were com- 
puted separately for the 18-19 and 25-34 age groups. Individual 
t-tests (Garrett, 1966 : 215) were then performed to find out if 
the two groups differed significantly with respect to their mean 
TàW scores on different tests. These critical ratios and their sig- 
nificance levels appear in Appendix G. 

An examination of the t-test results indicated that the 25-34 
age group scored significantly higher (P < .01) оп Comprehen- 
sion, Vocabulary, and Spelling section of the Language Usage 
Scales. These results are in agreement with those of many 
studies which have noted that the scores on Comprehension and 
Vocabulary scales continue to rise until the middle age (Gar- 
field & Bleck, 1952; Trembly, 1964; Wechsler, 1958 : 203- 
204). Тће individual t-tests also indicated that the subjects of 
the 18-19 age group scored significantly higher (P — .01) on 
Numerical Ability, Arithmetic, Reasoning, Classification, and 
Matrices scales. These results are consonant with the findings 
Which have demonstrated superior performance of younger 
groups on reasoning and performance tests (Riegel, 1959; 
Wechsler, 1958), 

It is, however, interesting to note that both the age groups 
9f the present study were matched overall with respect to their 
IQs on the WAIS. Table 3 indicates that the mean IQs of the 
18-19 and 25-34 age groups were 111 and 112, respectively. Fur- 
ther, both the groups had the same Verbal IQ (viz., 114) and 
differed only by a negligible margin in Performance 10. Also 
the differences in Verbal, Performance, and Full scale IQs bet- 


ween male and female subjects within each age group were 
negligible (see Table 3). 


s 
1. THE CORRELATIONS 
As indicated earlier, most of the marker variables of the 


E 
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TABLE 3: IQs for 18-19 and 25-34 Age Groups and Male and Female 
Subjects Within Each Age Group 


IQ M Е ғо: М Е Pool- Difference Pool- 
ed ed within ed 
18-19 25-34 18-19 25-34 
Verbal IQ 116 115 114 115 115 114 1 0 0 
Performance IQ 107 106 106 108 110 108 1 д п 
11298 0 1 


Full Scale IQ 113 112 ИЕ 13 113 


hosen on the basis of their similarities with 
of the WAIS. The assumption of these 
meaningful and valid if they 
WAIS. Therefore citations of 
kers with the WAIS were 
orrelations might further 
he present investigation. 


present study were c 
different subscales 
markers being similar would be 
correlate positively with different 
correlation coefficients of these таг 
considered informative in that these c 
justify the inclusion of the markers in t 
Since correlations serve as the basis for a factor analytic solu- 
tion, the differences in correlation coefficients across the 18-19 
and 25-34 age groups might be helpful in accounting for possi- 
ble differences in the factor structures between these groups. 
For the purpose of clarity and parsimony only relevant portions 
of the correlation matrices of 18-19 (see Appendix H) and 25- 
34 (see Appendix 1) age groups were included in the present 


section (see Table 4). 
In the 18-19 age group Verbal Reasoning scale was found to 
be significantly correlated (P < .05) only with the verbal scales 


of the WAIS. But in the 25-34 age group this scale correlated 
significantly with almost all the WAIS. A similar trend was 
also indicated for the Grammar section of the Language Usage 
scale. In the 18-19 age group this test correlated significantly 
(P < .05 or .01) only with the Information, Comprehension, 
Similarities, and Vocabulary scales. But in the 25-34 age group 
the same test correlated significantly with all the WAIS. Arith- 
metic Reasoning correlated significantly with a few WAIS (i.e., 
Arithmetic, Block Design, and Object Assembly) in the 18-19 


age group and with all the WAIS in the 25-34 age group. Also 


Advanced Progressive Matrices, Classification, Matrices, and 
Series correlated significantly (Р < 05 or .01) with a few WAIS 
in the 18-19 age group but with all the performance scales and 
most of the verbal'scales in t 


he 25-34 age group. АП these 
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findings suggest that while most of the marker variables were 
appropriate markers of the WAIS in both the groups they were 
perhaps more general as marker in the 25-34 age group. Тће 
generality of the markers with the WAIS which was found in 
the present study is consistent with some other results. For 
example, Welford (1958) has pointed out that the normal elder- 
ly have a remarkable capacity for organizing their behaviour 
strategically in the face of problem situations. Such a capacity 
often affects scores in many different tests іп а similar way and 
contribute to the greater number of correlations among various 
ability tests. This in effect suggests wider sources of variability 
of the WAIS for an older group which was evident in the pre- 
sent study. 

Space Relations of the DAT were found to be significantly 
correlated (Р < .05 or .01) with Arithmetic, Similarities, Block 
Design, and Object Assembly in both the groups. However, in 
addition to these common correlations, this scale was signifi- 
cantly correlated with Information, Comprehension, and Voca- 
bulary scales in the 18-19 age group but with Picture Comple- 
tion and Picture Arrangement scales in the 25-34 age group. 
Conditions were found to be similarly inconsistent in terms of 
its significant relationships with the WAIS subscales. For 
example, this marker was significantly correlated (P < .05 or .01) 
with Comprehension, Arithmetic, and Block Design in both 
the groups. However, in addition to these common correla- 
tions, conditions were found to be correlated with Information 
in the 18-19 age group but with Picture completion, Picture 
Arrangement, and Object Assembly in the 25-34 age group. 
These findings indicate that different sources of variability 
account for the performance on the same WAIS in the two age 
groups. Only then would the same markers correlate with 


different WAIS in the two age groups. 


2. FACTOR SOLUTIONS 


Based on the considerations outlined in the preceding chapter, 
a balanced decision was reached while attempting to choose 
cutting points to retain the factors for both the groups. Finally, 
eigen values of 1.02 and 0.95 were selected for the factor 
analysis of 18-19 and 25-34 age groups, respectively. These two 
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cutting points were most acceptable under the present con- 
ditions because they were in the neighbourhood of 1.00 (cri- 
terion of positive generalizability), met the criterion of the 5сгее 
test (see Figure 1), and resulted in an equal number of similar 
principal component factors in both the groups; the last being 
an unique requirement in the present investigation. 


——— 18 - 19 Age Group (Eigen volue corresponding the 


cutting point = 102) 


25 - 34 Age Group (Eigen value corresponding the 
cutting point = 095) 


EIGEN VALUE 


FACTOR 


Figure |. Scree Tesi 


The principal axis soluti 
were further rotated in асс Varimax criterion 
(Kaiser, 1958) which approxi 


ments of "simple structure” and “positive manifold”. The 
Varimax rotation was chosen over the other techniques because 
of the orthogonality (independence) among resulting factors 
which is needed for matching the factors of the present study. 
These Varimax rotated Solutions appear in Table 5 and Table 6 
for 18-19 and 25-34 age groups, respectively, 


3; COMMUNALITIES 
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TABLE 5 : Varimax Factors for 18-19 Age Group 
Variable Variable Factor 
Number I IL Ш ТУ У VI VII 
1 Inf 023 —630 —065 —321 —008 318 118 
2 Сотр 101 —790 077 —026 128 —015 —098 
3 Arith 285 —164 171 —740 043 118 093 
4 Sim —002 —692 005 160 002 —027 324 
5 DSp —033 003 872 —205 013 —061 114 
6 Уос 124 —757 050 —172 —112 —376 —152 
7 DSy —058 —053 —572 169 383 447 —107 
8 РС 165 —123 799 176 180 077 —073 
9 BD 625 —094 —272 —321 060 —242 150 
10 PA 185 —083 230. —252 559 —076 008 
1 OA 607 060 078 318 -078 —124 332 
12 VR 336 —476 078 —162 080 588 082 
13 SR 706 —332 103 —056 091 —047 187 
14 CSA —134 027 —052 090 818 093 077 
15 LU -S —036 —121 —084 —089 039 813 090 
16 LU-G 260 —485 040 077 —110 595 114 
17 МА 262 180 —182 —446 127 406 377 
18 AR 691 100 051 —211 053 337 —019 
19 MR 762 —209 112 —227 015 —177 —058 
20 PM-A 579 —135 130 016 031 181 356 
21 Ѕег 494 049 —080 —095 —059 183 053 
22 СІ 267 —005 055 —059 104 210. 765 
23 Mat 504 —107 128 —019 —216 188 107 
24 Cond 178 —352 047 —338 —106 —101 506 


Note : Decimal points omitted. 


proportion of accountable variance of the WAIS. For this rea- 
son the present study factor analysed the WAIS along with 
several marker variables. It was proposed that an assessment of 
psychometric invariance of the WAIS would be more meaning- 
ful if it is based on a greater proportion of accountable vari- 
ance (communality estimates or Й?) of ће WAIS. Further, as 
expressed in eq. 4, under a most ideal situation, the proportion 
of A*s of a scale should be the same as or at least be close to its 
reliability estimates (rj). It would be therefore important to 
examine the extent to which such requirements were met by the 
present study. The comparisons between the WAIS reliability 
estimates and the corresponding community estimates appear in 
Table 7. 
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TABLE 6: Varimax Factors for 25-34 Age Group 


Variable Variable Factor 
Number I П ШІ 1Ұ у VI ун. 
nf 074 13 021 156 —117 —027 84 
2 imp 068 646 086 174 —261 -048 100 
3 Arith 246 005 063 356 058 729 066 
4 Sim 075 582 041 31 141 —290 246 
5 D Sp 089 075 048 079 837 | 068 —018 
6 Voc 209 376 —045 119 1092 165 —154 
7 D Sy 212 09 753 157 091 165 —154 
8 PC 702 037 176 139 —062 229 392 
9 BD 730 120 056 198 —069 172 100 
10 PA 587 148 —064 —021 086 321 318 
11 OA 697 -01 179 090 164 —111 289 
12 VR 316 309 004 488 255 043 429 
13 SR 704 124 —084 269 176 133 002 
14 CSA 070 040 862 091 —018 —046 150 
15 LU-S —132 666 236 —173 239 443 090 
"16 LU-G 260 722 —039 131 150 071 158 
7 МА 046 188 082 732 —165 076 148 
18 AR 329 100 123 648 174 059 233 
19 MR 427 —061 —396 464 —055 285 152 
20 PM-A 490 144 135 533 216 —033 093 
21 Ser 553 —081 081 318 336 —241 —069 
22 СІ 400 —130 131 375 182 227 155 
23 Mat 369 162 080 668 093 160 -080 
24 Cond 688 198 099 203 —106 —053 —152 


Note : Decimal points omitted. 


TABLE 7 : Reliability Estimates (743) and Communalities (12) of the WAIS 
Subscales of Both the Groups 


Estimate ry he 
Source Wechsler (1958) Present Study rg; — h? 

18-19 25-34. 18-19 25-34 18-19 25-4 
Inf 91 91 .62 79 .29 42 
Comp 179 177 .67 54 12 23 
Arith 79 81 71 73 08 08 
Sim .87 85 .60 62 27 23 
D Sp 171 66 182 173 —.11 -O7 
Voc -94 .95 79 .68 15 27 
D Sy 92 - 172 71 20 = 
РС 82 .85 76 76 06 09 
вр 86 83 66 64 20 19 
РА .66 .60 48 -58 18 .02 
OA -65 68 61 65 :04 07 
Notes; 1. Reliability estimates 
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It is apparent from Table 7 that most of the 125 of WAIS 
іп the present study were close to their reliability estimates. 
This was true in both the groups. So much so, that in a few 
cases (i.e., Digit Span in both the groups) the /^s were actually 
higher than the reliabilities. Furthermore, if one is to accept an 
h? of .60 as an arbitrary minimum point to view a test variance as 
substantial, it could be seen that the present study was generally 
successful in its intent. АП the 125 except for Comprehension in 
18-19 and Picture Arrangement in both the groups were found 
to be above this point. Speaking in relative terms, one of these 
three #25 (1.е., for Picture Arrangement in 25-34 age group) 
was underdetermined only by 2%, with respect to its reliability. 
However, it should be pointed out that the factor analysis of 
the present study used ls as diagonal elements which might 
have inflated the components of the final factor matrices and 
subsequently the A's of different WAIS. Perhaps this was the 
reason why the 1? of the Digit Span scale were overdetermined 


with respect to its reliability estimates. 
4. INTERPRETATION OF FACTORS 


Ordinarily, variables with factor loadings of .30 and above 

would be evaluated to identify the factors. But such a figure 

may not always prove to be scientifically noteworthy especially 

with respect to the interpretation of factor (Horn, IA Waa: 
4 ^4 might be necessary to give greater 

fore, in the present study, it might Я А 

sad to vdd high loading variables particularly for interpreta- 


tio iguous factors. Е p 
үке т. criterion for interpreting factors of the 
present study would be to examine the nature of tests with 


i ‘s indirect ар 
near-zero loadings. This indirec | 
factors would be used only to one e к’ ог 
difficulties arising from the results of the first approach. 


(a) 18-19 Age Group 


Factor 1 


The variables with loadings above .30 on this factor are as 


follows: 
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19. Mechanical Reasoning + .762 
13. Space Relations + .706 
18. Abstract Reasoning + .691 

9. Block Design + .625 
11. Object Assembly + .607 
20. Advanced Progressive Matrices + .579 
23. Matrices + .504 
21. Series + 494 
12. Verbal Reasoning + .336 


This factor was interpreted as spatial conceptualization. 
The term ‘‘conceptualization” is used here to mean the ability 
to form a mental image as to how certain things might look if 
rotated or altered or moved according to a defined principle, 
given or implied. The interpretation of this factor is based on 
the process involved in the high loading variables such as Me- 
chanical Reasoning, Space Relations, Abstract Reasoning, Block 
Design, etc. АП these tests require the subject to conceptualize 
the answers ша spatial context using a reasoning process. 

It is interesting to note that Block Design and Object 
Assembly of the WAIS have consistently been identified as 
measures of perceptual organization (Cohen, 1957; Berger et 
al., 1964). In the present study, however, the first factor is 


ptual organization factor, be- 
ered a part of the latter which 


Deed not be viewed as a 


deterrent to the interpretation of the 
first factor. First of all, t i 


significant loading: T (ie., verbal relations) 
have near-zero loadi i i 
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factor (i.e., Mechanical Reasoning, Advanced Progressive Mat- 
rices, Series, etc.) appear to have similar reasoning components. 


Factor П 


The variables with loadings above .30 on this factor are: 


2. Comprehension —.790 
6. Vocabulary --.157 
4. Similarities —.692 
1. Information —.630 
16. Language Usage - Grammar —.485 
12. Verbal Reasoning —.476 
34. Conditions —.352 
13. Space Relations —.332 


This factor was identified as verbal relations. 'The first four 
high loading variables of this factor are all WAIS Verbal 
Scales (1.е., Comprehension, Vocabulary, Similarities, and In- 
formation) Тһе other high loading variables are Language 
Usage - Grammar, Verbal Reasoning, Conditions, and Space 
Relations which suggest the presence of a verbal component 
manifested in relational terms. The loading of two non-verbal 
variables (1.е., Conditions and Space Relations) are not suffi- 
ciently high to suggest this factor to be of a non-verbal nature. 
Rather the presence of these variables in the second factor 
could be attributed to their reasoning components which are 
evident in all other high loading variables. 

The verbal relations factor seems very similar to а verbal 
comprehension factor found in many previous studies on the 
WAIS alone (e.g. Cohen, 1957; Berger et al, 1964). The 
present study, however, included many marker variables which 
might have expanded the limited nature of the verbal compre- 
hension factor to broader process of verbal relations which is 
indicative in some of the WAIS and marker variables. 


Factor Ш 


Three variables load significantly on this factor. These are 
as follows: 
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5. Digit Span + .872 
8. Picture Completion + .799 
7. Digit Symbol — .572 


The third factor of the 18-19 age group was identified as a 
freedom from distractibility factor. While interpreting this 
factor the sign of the high loading variables were noted since 
they are not the same. The variables with high positive load- 
ings on this factor are Digit Span and Picture Completion which 
indicates the presence of a memory or carefulness process. 
However, a high negative loading of Digit Symbol which needs 
attention suggests this factor to be more of a process of freedom 
from distractibility than just a process of memory. The inter- 
pretation of this factor does not depart from the interpretation 
of similar process in other studies (1.е., Cohen, 1957; Berger 
et al., 1964). In fact Cohen (1952a, 1952b) has interpreted a 


freedom from distractibility factor in а factor analysis of the 
W-B I scales. 


Factor IV 


Six variables have loadings above .30 on Factor IV. These 
are: 


3. Arithmetic 


— .740 

17. Numerical Ability — 446 
24. Conditions — .338 
1. Information — .321 
9. Block Design = 1.321 
11. Object Assembly + .318 


The fourth factor of the 18-19 age group was identified as 
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resolving the ambiguity of this factor. In other words, if this 
factor really represents a process of numerical manipulation, 
the Object Assembly should prove itself to be non-numerical as 
well as non-manipulative in nature. This assumption is quali- 
fied by the fact that the Object Assembly scale has a high load- 
ing on a spatial conceptualization factor (i.e., Factor 1) which 
is non-numerical as well as non-manipulative. 


Factor V 


| The high loading variables on this factor are the follow- 
ing: 


14. Clerical Speed & Accuracy + .818 
10. Picture Arrangement + .559 
7. Digit Symbol + .383 


The fifth factor of the 18-19 age group was identified as 
perceptual speed. Three tests which have significant high load- 
ings on this factor are Clerical Speed and Accuracy, Digit 
Symbol, and Picture Arrangement. Ап examination of the 


nature of Clerical Speed and Accuracy and Digit Symbol scales 


indicates that higher scores on these variables are dependent 


оп one's ability to perceive simp 
proof of such perceptions through cer 


as possible. 
though manifest speed compo- 


The Picture Arrangement, 
nent, does not seem to measure à simple perceptual factor. For 


an average subject this scale is supposed to measure а relatively 
higher perceptual task. However, considering the sample of the 
present study which was constituted of university students, it 
seems likely that the items of the Picture Arrangement scale 
were easier and therefore the scores seem to have depended 


solely on the speed of performance. 


le visual symbols and give 
tain responses as quickly 


Factor УІ 


The high loading variables on this factor are the follow- 


ing: 
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15. Language Usage- Spelling + .831 
16. Language Usage- Grammar + .595 
12. Verbal Reasoning + .588 
7. Digit Symbol + 447 
17. Numerical Ability + .406 
6. Vocabulary + .376 
18. Abstract Reasoning + .337 
1. Information + .318 


The sixth factor of the 18-19 age group was identified as 
a language usage factor. There are eight variables which have 
loadings greater than .30. These are Language Usage – 
Spelling, Language Usage - Grammar, Verbal Reasoning, 
Digit Symbol, Numerical Ability, Vocabulary, Abstract Reason- 
ing, and Information. Of these, both the Spelling and the 
Grammar parts of the Language Usage scale contributed more 
than half of the total variance of this factor. The use ОҒ langu- 
age (in this case English) is also indicative in Verbal Reason- 
ing, Vocabulary, and Information scales. But Digit Symbol, 
Numerical Ability, and Abstract Reasoning are primarily non- 
language tests. However, an evaluation of the nature of these 
tests indicates that they often Tequire the subject to make use 
of “‘соуегг” language (i.e., counting in one's mind). 


Factor VII 


Six variables have high loadings on Factor VII: 


22. Classification 


+ .765 
24. Conditions + .506 
17. Numerical Ability 4.3717 
20. Advanced Progressive Matrices + .356 
11. Object Assembly 4.332 
4. Similarities + .324 


The last factor of the 18-19 age group was interpreted as 
analogy. The nature of this factor seems Straight forward. All 
the high loading variables of this factor (ie., Classification, 


Conditions, Numerical Ability, Advanced Progressive Matrices, 
Object Assembly, and Simil 


5 arities) manifest the process of 
analogy directly or indirectly. 
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(b) 25-34 Age Group 
Factor 1 


The relevant high loading variables on Factor I are: 


9. Block Design + .730 
13. Space Relations + .704 

8. Picture Completion + .702 
11. Object Assembly + .697 
24. Conditions + .688 
10. Picture Arrangement + .587 
2]. Series + .553 
20. Advanced Progressive Matrices + .490 
19. Mechanical Reasoning + .427 
22. Classification + 400 
23. Matrices + .369 
18. Abstract Reasoning + .329 
12, Verbal Reasoning + .316 


The first factor of the 25-34 age group was identified as 
spatial conceptualization. This factor seems to have a striking 
similarity with the first factor in the 18-19 age group. All the 
nine high loading variables of Factor I of the 18-19 age group 
are present in this factor. In addition to those nine, four other 
variables (i.e., Picture Completion, Conditions, Picture Arrange- 
ment, and Classification) load significantly on this factor. They 
all seem to represent a process of space conceptualization in 
terms of reasoning, logical thinking, or deduction. 

It could be observed that more than half of the total vari- 
ables of the present study load highly on this first factor 
which might erroneously suggest a process vaguely similar to a 
so-called ‘g’ factor. However, а closer examination indicates 
that all these high loading variables are performance or non- 
verbal variables. This is contrary to the nature of a general 
factor in which both non-verbal and verbal variables are 
supposed to load significantly. But most of the verbal variables 
of the present study load significantly on a language usage or 
verbal facility factor (i.e., Factors П & УП) of the 25-34 age 
group. The greater number of high loading variables on this 
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first factor is evident because most of the marker variables of 
the present study turned out to be performance – or spatial- 
related variables (see Table 4). 


Factor II 


The variables with loadings more than .30 on the second 
factor of the 25-34 age group are: 


16. Language Usage - Grammar 


+ .122 
15. Language Usage – Spelling + .666 
2. Comprehension + .646 
4. Similarities T .582 
6. Vocabulary + .376 
12. Verbal Reasoning + .309 


f This factor was interpreted as language usage factor. The 
high loading variables on this factor are Language Usage – 
Grammar, Language Usage – Spelling, Comprehension, Simi- 
larities, Vocabulary, and Verbal Reasoning. It seems that a 
Subject’s Success on all these tests depends on his ability in 
making use of language (in this case the English language) in 
terms of spelling, grammar, punctuation, and reasoning. This 
factor is very similar to the sixth factor of the 18-19 age 


group. 
Factor III 
Variables with relevant factor loadings on Factor ИГ are the 
following: 
14. Clerical Speed and Accuracy + .862 
7. Digit Symbol + .753 
19. Mechanical Reasoning — .396 


| This factor was identified as perceptual speed. The variables 
with positive high loadings on this factor are Clerical Speed 
and Accuracy and Digit Symbol both of which involve 
simple Perceptual tasks. For example, Clerical Speed and 
а Tequires the subject to identify a given symbol (e.g., 
) from among other symbols, The Digit Symbol scale also 


\ 
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requires the subject to associate certain symbols (e.g., =) with 
certain numbers (e.g., 9). In both the cases a subject is given 
sufficient practice trials which further simplify the tasks. The 
other important element which is common to both Clerical 
Speed and Accuracy and Digit Symbol is the element of time 
limit. Both these tests are given for certain amount of time 
during which no subject could possibly attempt all the items of 
the tests. In that sense both the Clerical Speed and Accuracy 
and Digit Symbol tests are basically speed tests. A subject's 
total score on these tests would therefore depend on the speed 


with which he responds or performs these simple perceptual 
factor as perceptual speed is 


tasks. The interpretation of this 
further qualified by significant negative loading of the Mechani- 
cal Reasoning scale which is essentially a power test. 


Factor IV 
Ten variables have factor loadings greater than .30 on Factor 
IV. They are: 
17. Numerical Ability + .732 
23. Matrices + .668 
18. Abstract Reasoning + .648 
20. Advanced Progressive Matrices + -533 
12. Verbal Reasoning + 488 
19. Mechanical Reasoning + .464 
22. Classification + .375 
3. Arithmetic + .356 
4. Similarities + .331 
+ .318 


21. Series 


The fourth factor of the 25-34 age group was interpreted as 
a logical thinking factor. At the surface, the nature of this fac- 
tor seems close to the first factor of the 25-34 age group. Of 
the ten high loading variables of this factor, seven have been 
found to have high loadings on the first factor of this group. 
Such a situation is rather difficult to interpret. Therefore it was 
necessary to find out the variables which load highly on this 
factor but not on the first factor. These variables are Numerical 
Ability, Arithmetic, and Similarities all of which require the 
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subject to think logically to get the right answers. The process 
of logical or deductive thinking is also evident in Matrices, 
Abstract Reasoning, Advanced Progressive Matrices, Verbal 
Reasoning, Mechanical Reasoning, Classification, and Series 


scales. This factor seems to be most similar to an analogy fac- 
tor in the 18-19 age group. 


Factor V 


Two variables have relevant loadings on Factor V. These 
are: 


5. Digit Span + .837 
21. Series + .336 


Digit Span which is supposed to measure a memory factor 
(see Cohen, 1957; Berger et al., 1964) loads very highly on this 
factor. The other high loading variable on this factor is Series. 
Therefore this factor was conveniently identified as a memory 
factor. It is likely that for the 25-34 age group, Series bears 
Some component of memory. This factor seems closest to the 


freedom from distractibility factor found in the 18-19 age 
group. 


Factor VI 


The high loading variables on the sixth factor are: 


3. Arithmetic + .729 


15. Language Usage – Spelling + .443 
10. Picture Arrangement + .321 


This factor was identified as a numerical speed factor. 
Though speed is reflected in all the high loading variables, 
Arithmetic was the only tes. 


t which manifests a numerical facility 
process. Further, the Numerical Ability test which should load 
highly on à numerical factor had actually a near-zero loading 
on this factor. Such a situation was difficult to explain proper- 
ly. Therefore the interpretation of this factor was more guided 
(rather forced) by the hig! 


t u hest loading variable (i.e., Arithmetic) 
which alone contributed more than two-thirds to its total 
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variance. This factor seems to be most similar to the fourth 
factor of the 18-19 age group. 


Factor VII 


The following four variables have significant factor loadings 
on Factor VII. 


1. Information + .846 
6. Vocabulary + .667 
12. Verbal Reasoning + .429 
8. Picture Completion + .392 


The last factor of the 25-34 age group was interpreted as а 
verbal facility factor. The high loading variables of this factor 
are Information, Vocabulary, Verbal Reasoning, and Picture 
Completion. All these tests seem to represent a common pro- 
cess which could be labelled as facility in verbal task. It is 
interesting to note that most of these high loading variables are 
present in the second factor of the 18-19 age group which was 


interpreted as verbal relations. 


5. FACTOR SIMILARITY ACROSS THE GROUPS 

It could be observed from the preceding section that no two 
factors of the 18-19 and 25-34 age groups were fully identical 
though spatial conceptualization, perceptual speed, and langu- 
age usage Were found in both. After а close study of the nature 
of the factors it was, however, possible to determine the most 
similar or approximately similar factors across the age groups. 
A table indicating factor similarities was then prepared to 
serve as reference for rearrangement of factor loadings which 
was essential for subsequent invariance analysis (see Table 8). 


6. INVARIANCE ANALYSES 


on of the pattern correlation co- 
efficient (г) was used to determine the similarities and differen- 
ces between the psychometric patterns of WAIS across the age 
groups. The basic assumption of this analysis is that the dimen- 
sions (іп the present context, the factors) be independent and 


Horn’s (1961) corrected versi 
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TABLE 8: Similar Pairs of Factors Across the 18-19 and 25-34 Age Groups 


Factor Age group Age group 
Order 18-19 25-34 
I (I) Spatial Conceptualization (I) Spatial Conceptuali- 
zation 
IT (II) Verbal Relations (VII) Verbal Facility 
ш (ПИ) Freedom from (V) Memory 
Distractibility 
IV (TV) Numerical Manipulations (VI) Numerical Speed 
№ (V) Perceptual Speed (III) Perceptual Speed 
VI (VI) Language Usage (II) Language Usage 
ҮП (VII) Analogy (IV) LogicalThipking 


Note: The number in parentheses indicates the order of that factor in 
the rotated Matrices of Table 5 and Table 6. For the purpose of 
subsequent analysis these orders were rearranged to be consistent 
with the orders of the first column. 


Scores of the profiles ог patterns have equal weights. The first 
assumption is implicit in orthogonal factors of the present study. 
The second assumption was approximated by converting all the 
Taw scores (in this case, factor loadings) to standard scores. 

Horn's r, formula is based on Cattell's (1949) pattern corre- 
lation and Rao's (1948) difference squared (D?). It presents 
an entirely new approach to pattern analysis. It is supposed to 

` indicate the degree of similarily or dissimilarity between any 
two patterns with respect to their shapes, levels, and accentua- 
tions (steepness) all of which are worth exploring in the present 
study. The value of r, varies from +1.00 through 0.00 to 
—1.00 indicating complete similarity (invariance), no relation- 
ship (lack of invariance), and complete dissimilarity (lack of 
invariance as well as complete difference) between any two 
patterns. An unique advantage of the corrected ry over many 
existing pattern analyses is that its significance levels could be 
determined from a table provided by Horn (1961). The results 
of such invariance analyses for all the WAIS appear in the last 
column of Table 9, 

The r, values for Arithmetic, Digit Span, Vocabulary, and 
Block Design were all Positive and. significant at the .01 level. 
The г» for Information was Positive and significant at the .05 
level. No test was found to have a significant negative т» Which 
would have implied a complete difference between factor load- 
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ing patterns of a certain scale across the groups. Thus the rps 
of Comprehension, Similarities, Digit Symbol, Picture Comple- 
tion, and Picture Arrangement were found to be insignificant in 
either direction (positive or negative). This suggested that 
though the above scales were psychometrically non-invariant, 
none of them was found to be completely different. А complete 
difference between any two patterns would have been indicated 
if the r,s were negative and significant at a certain acceptable 
level (see Horn, 1961). The significance levels of negative 7,5 
could also be determined from Horn's table. 

The factor loadings were also plotted to observe the stability 
of psychometric components of the WAIS across the age groups. 
Thus, for each scale two separate curves representing 18-19 and 
25-34 age groups were also plotted with factor loadings on Y 
axis and similar factors on X axis (see Figures 2, 3, and 4). As 
expected from the rp values, the curves for Information, Arith- 
metic, Digit Span, Vocabulary, and Block Design were very 
similar with respect to shapes, levels, and steepness. For the rest 
of the WAIS the curves for 18-19 and 25-34 age groups Were not 
very similar. у 

It is perhaps important to discuss further the implications of 
all three possible outcomes of pattern analysis (i.e., significant 
positive, insignificant, and significant negative гр values). In the 
present context when ап rp value between two factor loading 
patterns of a scale is found to be positively significant it would 
indicate a case of psychometric invariance of that scale. If such 
ап гр value is insignificant it would, however, suggest a case of 
lack of psychometric invariance of that scale. But if ап г» value 
is negative and significant it would represent a case of psycho- 
metric non-invariance as well as psychometric difference meaning 
thereby a certain test measures distinctly different things (factors) 
across the age groups. This distinction between lack of psycho- 
metric invariance (indicated by all the г,5 except positively signi- 
ficant ones) and psychometric difference (indicated by significant 
negative г») is particularly important to appreciate fully the 
implications of the present results. Therefore, it would seem that 
the lack of psychometric invariance is inherent ina case of 
psychometric difference of a scale but the reverse is not true, 
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CHAPTER IV 


Discussion 


The factors of the present study were very much similar to 
those found by the other investigations of the WAIS or similar 
tests. For example, the Verbal Relations of the 18-19 age group 
and the Verbal Facility of the 25-34 age group are very similar 
to a Verbal Comprehension factor found by Davis (1956), Co- 
hen (1957), апа Berger et al. (1964). The Spatial Conceptuali- 
zation which was evident in both the groups of the present 
study seems to be similar to Staley's (1973) Spatial Visualiza- 
tion and Horn and Cattell's (1966) “Яша” factor. Also the 
Freedom from Distractibility factor of the 18-19 age group and 
the Memory factor of the 25-34 age group have been found in 
almost all the studies on W-B I and WAIS (Berger et а!., 1964; 
Cohen, 19522, 1952b; Green & Berkowitz, 1964; Riegel & 
Riegel, 1962). The Perceptual Speed factor which was evident 
in both the groups has been identified by Davis (1956) under a 
different name (i.e., General Speediness). Davis has also found 
a Numerical Speed Facility factor which was found in the 
18-19 (Numerical Manipulations) and 25-34 (Numerical Speed) 
age groups of the present study. The Analogy factor of the 18-19 
a£e group and Logical Thinking of the 25-34 age group have 
also been identified by Staley and Davis under different names 
(i.e., Ability to Perceive Relationships, Logical Reasoning, and 
General Reasoning). 

The Language Usage factor which was evident in both the 
groups of the present study has not been proposed by any of the 
factor analytic investigations of WAIS subscales. The emer- 
Бепсе of Language Usage factor was perhaps due to the inclu- 
sion of Spelling and Grammar parts of the Language Usage and 
Verbal Reasoning scale in the present study all of which were 
the principal contributors to the variance of this factor in both 
the groups. 


The present study included а number of marker variables to 
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raise the magnitude of accounted variance (Л?) of the WAIS 
through the emergence of strong or overdetermined factors. It 
is therefore important to find out whether or not these markers 
were actually similar in relation to the WAIS. 

Most of the marker variables of the present study did in 
fact prove to be appropriate markers in that they all correlated 
with different WAIS. Among them Verbal Reasoning, Gram- 
mar section of the Language Usage, Abstract Reasoning, Ad- 
vanced Progressive Matrices, Classification, Matrices, and 
Series were perhaps the most appropriate markers because they 
correlated with most of the WAIS subscales in both the groups. 
Clerical Speed and Accuracy was the only scale which was 
found to be relatively less general as a marker of the WAIS 
because it correlated significantly only with the Digit Symbol 
scale in both the groups. Space Relations ,and Conditions were 
found to be somewhat inconsistent as markers in that they had 
very few common significant correlations and more unique 
significant correlations across the groups. As indicated 
earlier, this was perhaps due to different sources of variability 
of WAIS across the age groups. Only then could the same 
markers correlate differently with the WAIS across the age 
groups. р E 

The principal purpose of the present investigation was to 
assess the stability of psychometric compositions of the WAIS 
subscales across certain specified groups under the conditions 
of maximum possible accounted variance (А?) for these scales. 

f the obtained А5 would indicate the 


Perhaps an examination о р te t 
extent to which the present study was successful in achieving 


this prerequisite for the subsequent invariance analyses. 
Considering a value of .60 as arbitrarily significant it could 
be observed that 19 out of the 22 (11 WAIS X 2 groups) h?s of 
the present study were beyond this point leaving behind only 
three which were in the neighbourhood of .50. This indicates 
that greater percentages of the total variance of any tests are 
accounted for if these tests are factor analysed with appropri- 
ate marker variables. The generality of this finding with res- 
pect to the /f*s of the WAIS has also been supported by Staley 
(1973). Based on the Varimax solutions of Staley’s 18-19 age 
group it was found that the #25 of the Digit Span, Arithmetic, 
and Similarities were all above 60. Block Design was the only 
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scale іп Staley's study that missed this arbitrary point by a 
small margin. im 

Perhaps reliability estimates (r4) are the toughest criteria 
against which the obtained 125 could be tested to determine the 
extent to which the present study was successful in accounting 
for reliable variance of the WAIS. It could be observed from 
Table 7 that such a comparison was even more encouraging. 
For most of the WAIS the difference between the present hs 
and the corresponding reliability estimates were small. Interest- 
ingly, one of the three scales with less than .60/? in absolute 
sense (1.е., Picture Arrangement in the 25-34 age group) did in 
fact differ from its reliability estimate only by a margin of .02. 
This would mean that the present study was successful in 
accounting for all the variance of the P. 
except for 2%. 

A relative comparison of A? 
estimates further indicated that 
cessful in accounting for the va 
mance scales than the verbal sc. 
be related to the choice of the 
(approximately two 


icture Arrangement scale 


$ and corresponding reliability 
the present study was more suc- 
riance of most of the perfor- 
ales. Such a condition seems to 
marker variables most of which 
-thirds) proved to be performance-related 
Scales (see Table 4). The greater proportion of performance- 
related markers may have resulted in the emergence of a strong 
Spatial Conceptualization factor in both the groups. On the 
other hand, verbal-related markers were comparatively fewer 
in the present study which was less likely to lead to a similar 
Strong or overdetermined verbal factor. 

The А5 of the WAIS in t 
Support the hypothesis of Cat 
Davis' (1956) results. 


he present study overwhelmingly 
tell (1952) and the implications of. 


Accordingly, the inclusion of marker 
variables in a factor analysis of certain tests should help to 


determine greater accountable variance (Л?) of those tests; a 
condition considered as a necessary prerequisite for the assess- 
ment of psychometric invariance (Aftanas, 1971a). On the basis 


€ concluded that such а condi- 
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was a statistical inference based on the pattern correlation 
coefficient (ғ) between а scale's factor loading patterns across 
the two age groups. 

Based on the above considerations, the Information scale 
was found to be psychometrically invariant across the present 
age groups. The contribution to the 12$ of this scale mainly 
came from Verbal Relations (1.е., 40%) and Verbal Facility 
(і.е., 64%) factors in the 18-19 and 25-34 age groups, гезрес- 
tively. These two factors were considered to be the most similar 
pair of factors found in the two groups. A more detailed 
examination indicated that in the 18-19 age group the Infor- 
mation scale received approximately 20% of its total variance 
from Numerical Manipulations and Language Usage factors 
which were unique to this group. However, this different 
sources of variability of the Information scale was rejected by 
the statistical criterion. The rp between the psychometric com- 
ponents of this test across the age groups was found to be 
positive and significant at the .05 level. It suggested that the 


Information scale is psychometrica 
the age groups of the present stu 
however, be viewed with respect to the 
of the reliable variance was unaccounte 
25-34 age groups, respectively. 

One interesting thing with regard to the present findings is 
that these results were in close agreement with those found by 
the previous investigators. For example, in Cohen's (1957) 
study Information was found to have significant loadings on a 
Verbal Ccomprehension factor across the 18-19 and 25-34 age 
groups. The results obtained by Berger et al. (1964) study are 
also in agreement with those of the present study. In their study 
Information was found to load significantly on a Verbal Com- 
prehension factor in both 18-19 and 25-34 age groups. 

The Arithmetic scale was also found to be psychometrically 
stable across the age groups of the present study. Visual exami- 
nation of the psychometric components indicated that two 
similar factors (i.e, Numerical Manipulations and Numerical 
Speed in the 18-19 and 25-34 age groups, respectively) contribu- 
ted more than 50% to the total variance of the Arithmetic 
scale. The only difference in these two psychometric patterns 
was that a Logical Thinking factor contributed 12% to this 


Пу invariant, at least across 
dy. Such a finding should, 
fact that 29% and 12% 
d for in the 18-19 and 
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scale’s variance only in the 25-34 age group. The observed 
psychometric stability of Arithmetic scale was further supported 
by the corresponding r, which was positive and significant at 
the .01 level. The present results with regard to the Arith- 
metic scale are supported by Staley (1973) in the context of 
different age groups (i.e., 18-19 and 20-24). 

It could be recalled that contrary to the present results, 
Aftanas (1971b) observed lack of stability of psychometric 
components of the Arithmetic scale across the age groups 
Which he inferred from the Berger et al. (1964) data. There 
Seems to be several reasons for this difference. First of all, 
Aftanas interpreted the results of Berger et al. (1964) which 
used the highest correlations of the column/row as the com- 
munity estimates as opposed to ls in the present study. Also 
the results of the Berger et al, (1964) study are based on WAIS 
subscales whereas the results of the present study are based on a 
host of marker variables in addition to the WAIS subscales. 
Finally, the previous interpretations were directed towards 
four age groups (i.e., 18-19, 25-34, 45-54, and 60-75-- in Berger 
et al.) whereas the implications of the present results are 
Testricted only to the 18-19 and 25-34 age groups. In that sense, 
perhaps Aftanas is right in suspecting the psychometric invari- 
ance of the Arithmetic scale in the context of the entire adult 
span. The present Tesults, however, do not support or reject 


the contentions with regard to the stability of psychometric 
components of the Arithmetic scale. 


The pattern correlation coefficient for the Digit Span was 


:95) and was significant at the .01 level. 


and 25-34 age groups. 

The obtained results with терага to the Stability of psycho- 
metric contents of the Digit Span scale Seem to contradict those 
found by Berger et а]. (1964). In their Study the variance of the 
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Digit Span scale was accounted for by a Verbal factor in the 
18-19 age group and a Memory factor in the 25-34 age group. 
Berger et al. interpreted their findings in terms of Memory 
**coalescing" with Verbal factor in the former age group. On 
the contrary, the inclusion of several marker variables in the 
present study perhaps resulted in ''splitting" (a process oppo- 
site to coalescing) of factors to more primary ones. Therefore 
the age-related differences in psychometric patterns of the Digit 
Span in the Berger et al. (1964) study might have been an 
artefact resulting from its methodological limitations. 
Vocabulary was another among the WAIS which was found 
to be psychometrically invariant. In the 18-19 age group Verbal 
Relations and Language Usage contributed 55% and 13% res- 
pectively to the variance of the Vocabulary scale. In the 25-34 
age group Verbal Facility and Language Usage factors accoun- 
ted for 45% and 13% respectively to its accounted variance. 
An examination of the graphs indicated that the patterns of 
psychometric components in both the groups were almost iden- 
tical (see Figure 3: Vocabulary). The pattern correlation coeffi- 
cient between the psychometric components of the Vocabulary 
scale was found to be .92 which was significant at the .01 level 
(see Table 9). This, too, suggested a high degree of psychomet- 
ric stability of the Vocabulary scale across the age groups of 


the present study. 
The findings of the presen 


with those found by Cohen (1957 
noted similar results for the Vocabulary scale across the same 


age groups. However, these findings could not be regarded as 
entirely conclusive. For this scale's variance was underdeter- 
mined by wide margins of 15% and 27% in the 18-19 and 
25-34 age groups, respectively (see Table 7). 

In the present study Block Design was also found to be 
psychometrically invariant. А Spatial Conceptualization factor 
contributed to this scale’s variance by 38% and 53% in the 
18-19 and 25-34 age groups, respectively. Unique to the 18-19 
age group was a Numerical Manipulation factor that contribut- 
ed approximately 10% to this scale’s total variance. The invari- 
ance of psychometric components of the Block Design scale 


was also supported by а positive pattern correlation coefficient 


which was significant at the .01 level. It implies that Block 


t study seem to be in agreement 
) and Berger et al. (1964) who 
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Design measured essentially the same factors for the two age 
groups; a finding consistent with that in the Berger et al. (1964) 
and Cohen (1957) studies. 

The present results seem to contradict the observations of 
Staley (1973) who noted Block Design as a measure of Visuali- 
zation in the 18-19 age group and Logical Reasoning in the 
25-34 age group. However, the Spatial Conceptualization and 
Numerical Manipulation factors of the present study are very 
similar to the Visualization and Logical Reasoning factors of 
Staley's study. In that sense the only point of conflict seems to 
be a near-zero contribution of the Visualization factor to the 
Variance of the Block Design scale in Staley’s study contrary to 
а significant contribution of a similar factor (i.e., Spatial Con- 
Ceptualization) in the second group. The reason for this conflict- 
ШЕ results seems related to the age groups sampled in the 
concerned studies. For example, Staley's second Broup consist- 
ed of subjects between the ages of 20 and 24 where as the 


Second group of the present study consisted of subjects between 
the ages of 25 and 34. 


Scale across the grou 
group a Verbal Relation 
the 25-34 age group a 
maximum of 41% to 
Table 9, and Figure 
confirm Matarazzo’. 
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exclusive or dissimilar factors. Rather on a general level the 
Language Usage could be considered as a part of the Verbal 
Relations factor. However, these two factors were not 
matched with each other. The factor matchings of the present 
study were done with reference to the other factors in a search 
to find out the most similar pairs of factors. Considering such 
a global approach, the Verbal Relations Factor of the 18-19 age 
group was perhaps the most suitable match of the Verbal 
Facility factor of the 25-34 age group. 

In addition to the disadvantages of factor matching there 
seems to be another difficulty which cautions against any 
straightforward conclusions with regard to the psychometric 
invariance of the Comprehension scale. It could be recalled 
that in the present study a substantial percentage of the reliable 
variance of the Comprehension scale was not accounted for, 
particularly in the 18-19 age group (see Table 7). Such a situa- 
tion did not seem to create a comfortable base for any tangible 
conclusions concerning the stability of psychometric patterns of 
the Comprehension scale. 

Similarities were found to be the only scale for which 
reliable variance was underdetermined by more than 20% in 
both the 18-19 and 25-34 age groups. Therefore, any observa- 
tions concerning the psychometric invariance of this scale would 
be rather less conclusive. However, on the basis of whatever 
reliable variance was established it could be pointed out that 
the Similarities scale did not prove itself to be psychometri- 
cally invariant across the present age groups. This scale was 
found to have one pair of similar factors (ie., Analogy and 
Logical Thinking in the 18-19 and 25-34 age groups, respec” 
tively) as a common source of variance each of which contri- 
buted approximately 10% to the total variance of the 
Similarities scale. In addition to this, Verbal Relations alone 
contributed 64% to this scale's total variance in the 18-19 age 
group. In the 25-34 age group approximately 34% of the reli- 
able variance of the Similarities scale was contributed by a 
Language Usage factor. This trend was further supported by 
a near-zero pattern correlation coefficient between the psycho- 
metric components of this test across the groups. С М: 

The present results with regard to the psychometric Invart- 
ance of the Similarities scale seem to be inconsistent with those 
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found by Staley (1973). In his study only a Concrete Reasoning 
factor contributed (i.e., 16%) to the accounted variance of the 
Similarities scale in the 18-19 age group. On the other hand, in 
the 25-34 age group a Non-Quantitative factor contributed to 
this test's variance by more than 20%, 

The results of the present study and the observations of 
Staley both seem to be in conflict with those found by Cohen 
(1957) and Berger et al. (1964) in which the psychometric 
invariance of the Similarities scale was suggested. These 
differences, however, could be attributed to the methods of 
analysis used in the concerned studies. For example, both 
Cohen and Berger et al. used Thurstone's (1938) oblique solu- 
tions for Subsequent rotations. On the other hand, Staley and 
the present study used Hotelling's (1933) principal component 
solutions and Kaiser's (1958) Varimax rotations for the above 
purposes, 

The results concerning the psychometric invariance of the 
Digit Symbol scale were rather confusing. In the 18-19 age 
group, too, many factors contributed to this scale's total vari- 
ance as opposed to one significant contributing factor in the 
25-34 age group. For example, in the first group Freedom from 
Distractibility, Perceptual Speed, and Language Usage contri- 
buted to Digit Symbol's variance by 32%, 14%, and 19%, 
respectively. But т the second group only a Perceptual Speed 
factor contributed 55% to the total variance of this scale (see 
Table 9). An examination of the graphs representing psycho- 


metric components of the Digit Symbol scale indicates dissimi- 
larity between the grou 


findings contradict par! 
which the Digit Symb 
Digit Symbol factor) 
On the contrary, Be 
* with those found in 
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example, all the subjects except for 10 volunteers in the 25-34 
age group were told that they would not receive any feedback 
about their test results. Perhaps this denial of feedback created 
a general lack of seriousness ог inattention particularly in the 
younger group. But there seem to be no studies suggesting age- 
different reactions to the denial of feedback. Therefore the 
obtained lack of psychometric invariance across the two age 
groups of the present study may well be intrinsic to the Digit 
Symbol scale. 

. The Picture Completion scale was found to lack psychomet- 
ric invariance across the age groups of the present study. In the 
18-19 age group Freedom from Distractibility was the only 
significant factor which contributed 62% to the total variance 
of this test. But in the 25-34 age group Spatial Conceptualiza- 
tion and Verbal Facility factors contributed significantly to this 
scale's variance. The ғ; value between the psychometric compo- 
nents of this scale across the age groups Was found to be non- 
significant (i.e., —.17). This finding could be viewed as more 
conclusive because the total accounted variance of Picture 
Completion scale was marginally underdetermined for both the 


groups (see Table T). 

The sources of variabilit 
in the 25-34 age group аге 56 
with Cohen's (1957) study in W 
measure a Picture Completion fa 
group this scale measured Freedom 
a result unusual but not completely 
general nature of the younger gro 
perhaps for this group the accomplis 


pletion scale was mainly dependent o 
to the test materials. The nature of this scale: supports this 
hypothesis because according to Matarazzo (1972) Picture Com- 

t of attention (Freedom from 


pletion demands some amoun › 
Distractibility) as а minimum prerequisite in order to notice 
the missing parts of different objects. The possible implication 
of general inattention in the younger group has already been 
discussed in another context. 

The Picture Arrangement scale was found to lack psycho- 
metric invariance across the age groups of the present study. 
In the 18-19 age group 4 Spatial Conceptualization factor 


y of the Picture Completion scale 
nerally consistent, particularly 
hich this scale was found to 
ctor. But in the 18-19 age 
from Distractibility factor; 
unexpected considering the 
up. As pointed out earlier, 
hment in the Picture Com- 
n the subject’s attention 
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contributed 33% whereas in the 25-34 age eroup а Perceptual 
Speed factor contributed by to 30% the accounted variance of 
the Picture Arrangement scale. This was further confirmed by an 
insignificant pattern correlation coefficient between the factor 
loading patterns of the Picture Arrangement scale. The signifi- 
cant contributions of a Spatial Conceptualization factor seem 
to be in agreement with the other studies in which a Percep- 
tual Organization factor contributed almost equally to the total 
variance of the Picture Arrangement scale across the 18-19 and 
the 25-34 age groups. 

The indication that the Picture Arrangement scale mea- 
sured a Perceptual Speed factor in the 18-19 age group need not 
be viewed as unexpected because the scoring of this scale was 
done not only on accuracy of performance but also the time 
required to complete the problems. Perhaps this speed aspect 
of the Picture Arrangement problem overshadowed its accu- 
тасу aspect in the younger group. 

A Spatial Conceptualization factor contributed 369/, and 
47%, Tespectively to the accounted variance of the Object 
Assembly scale in the 18-19 and 25-34 age groups. This was 
consistent with the findings of Berger et al. (1964) and Cohen 
(1957) who reported a similar factor (i.e., Perceptual Organiza- 
tion) contributing to the accounted variance of this scale. In 
addition to this common factor, Numerical Manipulations and 
Analogy each contributed approximately 10% to the variance 
of this scale in the 18-19 age group. 

The lack of psychometric Stability of the Object Assembly 
scale is perhaps due to various approaches which might be in- 
volved in solving the Problems of this test. Wechsler (1958), 
for example, lists at least three possible ways a subject might 
approach the problems of this scale. These alternate approach- 
es could be an immediate perception of the whole accompanied 
by a critical understanding of relations among the parts or a 
rapid recognition of the whole but imperfect understanding of 


the relations among the parts or a trial-and-error approach. lt 
is therefore possible that subjects belonging to different age 
groups might act differ 


ently in their attempts to solve the pro- 
blems of the Picture Arrangement scale. 


The notion of fluid and crystallized intelligence and their 
developmental functions in particular seem to provide adequate 
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explanations for the lack of psychometric stability of some of 
the WAIS subscales which were found in the present study. 
According to this theory all the primary abilities are organized 
into two principal dimensions such as fluid intelligence and 
crystallized intelligence (Cattell, 1957, 1963; Horn, 1965; Horn 
& Cattell, 1966). The fluid intelligence (‘gf’) is said to be a pro- 
duct of the influences of biological factors which starts declin- 
ing in the mid-twenties. Crystallized intelligence (‘вс’) is 
believed to be a product of socio-cultural learning which grows 
until the late adulthood (Horn & Cattell, 1967). 

Relating the psychometrically non-invariant scales of the 
present study with the other theoretical formulations it could 
be observed that the nature of the psychometrically поп- 
invariant scales (i.e., Picture Completion, Picture Arrangement, 
and Object Assembly) seems similar to the measures of fluid 
intelligence because the performance on these tests is supposed 
to be independent of socio-cultural learning. Since fluid intel- 
ligence declines after the mid-twenties (Horn & Cattell, 1967), 
one would expect that the sources of variability of the above 
scale attributable to a fluid-type factor (i.e., Spatial Conceptua- 
lization) would be appreciably greater in the older group than 
in the younger group. Ап examination of the sources of variance 
of the Picture Completion Scale confirms this assumption. For 


example, the Spatial Conceptualization factor contributed more 


than 50% to the total variance of this scale in the 25-34 age 


group compared to only 15% in the 18-19 age group. Similarly, 
the Spatial Conceptualization factor contributed to the total 
variance of the Picture Arrangement scale by 33% in the 25-34 
age group compared to only 3% in the 18-19 age group. This 
fact was also evident for the Object Assembly scale which was 
found to be psychometrically non-invariant in the present study. 
In the 25-34 age group the Spatial Conceptualization factor 
contributed 47% to this scale's total variance compared to 30% 
in the 18-19 age group (see Table 9). 

The other group of non-invariant scales of the present 
study were Comprehension and Similarities both of which could 
be considered аз measures of crystallized intelligence because 
the performance on these tests seems to be dependent on socio- 
cultural learning. Since crystallized intelligence keeps growing 
until late adulthood (Horn & Cattell, 1967), one would expect 
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that a crystallized-type factor (i.e., Verbal or Language Usage) 
would contribute appreciably more to the variance of the 
Comprehension and Similarities scales. This hypothesis is also 
supported in the present study. It could be observed that in 
the 18-19 age group а Verbal Relations factor contributed 62% 
to the total variance of the Comprehension scale as opposed to 
only 1% in the 25-34 age group. Similarly, а verbal factor 
(Factor VII) contributed 4795 to the variability of the Similari- 
ties scale in (ће 18-19 age group compared to only 5% in the 
25-34 age group. 

It was difficult to relate the psychometric non-invariance 
results of the Digit Symbol scale to any existing theory because 
there is hardly any agreement as to what this scale actually 
measures. For example, Cohen (1952a, 1952b) found that the 


ale is associated with Freedom 
Г 1 Organization, Visual Organiza- 
tion, and Simple Speed factor for subjects of different ages. 


hat although a cross-sectional 
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relationships. Before this is done it is perhaps important to out- 
line the meaning of these terms. 

Reliability refers to the consistency of test scores obtained 
by the same test when administered at different occasions or to 
different groups of individuals at the same point in time 
(Anastasi, 1968; Cattell, 1964; Gulliksen, 1950; Guttman, 1955). 
Validity refers to the extent a test measures what it intends to 
measure. According to this approach, the investigator attempts 
to determine the degree to which the factor loadings of a 
measure are identified with the constructs it intends to measure 
(Cronback & Meehl, 1955; Guilford, 1954; Gulliksen, 1950; 
Loevinger, 1957). On the other hand, the assessment of psycho- 
metric invariance consists of determining the ‘‘degree to which 
the sources of variability associated with a measure are inva- 
riant under conditions of change” (Aftanas, 1971а). 

It could be further pointed out that psychometric invariance 
seems to emphasize two key points. First of all it is based ona 
multivariate approach to the variance of a test. Such an 
approach is considered more realistic (Thurstone, 1947) and has 
definite advantages over a single score approach (Guilford, 1948). 
Secondly, an assessment of psychometric invariance intends to 
evaluate the consistency ог stability (invariance) of these 
multiple sources of variance of atest across some specified 
dimensions (i.e., groups, occasions, equivalent tests, etc.) 

Relating reliability with the underlying requirements of the 
psychometric invariance assessment of a measure it would seem 
that a traditional reliability test examines only the consistency 
or stability of a single score across а specified dimension (i.e., 
groups, occasions, etc.) but lacks a multivariate approach to the 
test variance (see Table 10). Therefore, the concept of psycho- 
metric reliability is introduced here to mean what Aftanas 
referred to as an assessment of consistency of psychometric 
components (and not of a single score) of a test when adminis- 
tered across the groups (ї:е., developmental or cultural), occa- 
sions (i.e., time periods), tests (i.e., equivalent or parallel forms), 
etc, This would represent Cattell’s (1964) transferability or 
hardiness reliability to mean consistency across the groups in a 
multivariate context. 

It is important to note that the results of the present study 
could be used as indices of psychometric reliability of different 
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TABLE 10 : Schematic Representation of the Relationship between Psycho- 
metric Invariance and Reliability and Validity 


Traditional Test Psychometric Invariance 

Requirements Approach is Multi- Consistency is the 
variate Goal 

Reliability Lacks Multivariate Examines consistency 
approach to the test of total score across 
variance occasions, equivalent 

forms, etc. 

Validity Based on multivariate Does not examine 
approach to the test consistency across any 
variance dimension 


also conclude that 
Symbol, Picture Comp 
Assembly subscales we 


metric consistency across the age dimension. 

A traditional test of Validity is based on a multivariate 
approach to a test variance but lacks the consistency or stability 
Tequirements of а psychometri invariance assessment (see 
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they are identified with is observed across the age dimension. 
It could also be pointed out that the Comprehension, Similari- 
ties, Digit Symbol, Picture Completion, Picture Arrangement, 
and Object Assembly subscales lack psychometric validity 
because they all suffered from the lack of stability across the 
age groups in terms of what they are identified with. 
According to Puhan (1978c), the implications of psycho- 
metric invariance of a test are far more useful than those of 
traditional reliability and validity assessment. For instance, a 
psychometric invariance assessment across time would examine 
the stability of factor loading patterns of that test across two 
different occasions. This would represent a case of test-retest 
psychometric reliability. Such an invariance assessment, too, 
could be used to answer whether or not the major sources of 
variability of a test are consistently identified with the con- 
struct(s) being measured across time periods to represent a 
case of psychometric validity across time. Similarly, a psycho- 
metric invariance assessment across -two parallel tests would 
not only represent parallel-form of psychometric reliability but 
also psychometric validity across equivalent tests. Puhan (1978c) 
further proposed for replacement of traditional reliability and 
validity assessments of a test by an appropriate kind of psycho- 


metric invariance assessment. 
One of the difficulties with the psychometric invariance 


assessment perhaps relates to a fundamental level where the 
investigator might get trapped between two conflicting opera- 
tions; the techniques of factor matching across any two or more 
groups and the possibility of psychometric non-invariance of 
any tests. 

On the basis of other results (і.е., Cohen, 1957; Berger et al., 
1964) one cannot rule out the possibility of non-invariant psy- 
chometric components of a test across any two groups. In fact 
the results of the present study appear to confirm such а possi- 
bility. On the other hand, if the psychometric components of a 
test across the groups are different it is almost impossible to 
match the factors adequately which is a necessary prerequisite 
for any kind of invariance analysis. Perhaps an hypothetical 
example would be helpful to explain this point. 

Let us assume that the Digit Span scale really represents an 
extreme case of psychometric non-invariance across two age 
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groups (i.e., group А and group B). This could mean that the 
Digit Span would load significantly on a Memory factor in 
group A and an Analogy factor in group B. Let us further 
assume that the Similarities scale represents another extreme 
case of psychometric non-invariance across the same age groups. 
This could mean that the Similarities scale would load signifi- 
cantly on an Analogy factor in group А and a Memory factor 
in group B. In fact, both these assumptions are within the scope 
of psychometric invariance. They simply indicate what might 
possibly happen to the Sources of variance of a test across the 
groups (see Table 11: Before Matching). 


TABLE I1: А Hypothetical Example of an Inherent Problem with the 
Assessment of Psychometric Invariance 
BEFORE MATCHING 
Group A Group B 
Factor Factor 
I п 1 п 
Test Memory Analogy Test Memory Analogy 
mm A Pea НЫ 
isl * 
1 Digit Span | —_ —— | ! Digit Span —— € 
2 Similarities | ___ —— | 2 Similarities | *_ 


а=; 

Interpretation : Analogy Memory 

AFTER MATCHING 
Group A Group B 

Factor Factor 
H 
Memory Analogy 
re Tr аЬ 


I n I 


Test Memory Analogy Test 
аса. 


1 Digit Span Et 


= —— | 1 Digit Span | 
2 Similarities 


2 Similarities | —— 
ы | М Е: 
*Significant factor loading. 


Now, since the т 
dance with the high 1 
the investigator woul 
an Analogy factor b 


an analogy test Е 
would most likely i 
а Memory factor bi 


terpretation of a factor is done in accor- 
oading variables, it is more th. 
d interpret a Memory factor 
ecause Similarities (the high 1 
ollowing the same logic, 
nterpret a real Analogy fact 
ecause its high loading vari 


an likely that 
of group B as 
oading test) is 
the investigator 
or in group B as 
able is Digit Span 


Discussion 3 15 


which is supposedly a measure of Memory. There seems to be 
no way to determine that Digit Span really measures or loads 
on an Analogy factor in group B. Being unaware of this possi- 
bility, the investigator would then reorder or match factor И 
of group B with factor I of group A and factor I of group B 
with factor II of group A (see Table 11: After Matching). Не 
would thereby conclude erroneously that both Digit Span and 
Similarities are psychometrically invariant. In effect, a situation 
like this might misguide the investigator to cover up rather than 
discover the real differences in the psychometric patterns of a 
test between the groups. 

1t should be pointed out that the possibility of such a cover- 
up seems to have only limited significance to the results of the 
present study. This difficulty seems applicable only to the legi- 
timacy of the matchings of Perceptual Speed and Freedom from 
Distractibility factor of the 18-19 age group and Perceptual 
Speed and Memory (doublet) factors of the 25-34 age group in 
the present study. This may explain, at least partially, the ob- 
tained lack of psychometric invariance of the Digit Symbol 
scale which loaded on the Perceptual Speed factors of both the 
groups. It might well be that the Digit Symbol scale measured 
a Perceptual Speed factor in the 18-19 age group and a Free- 
dom from Distractibility factor in the 25-34 age group and 
Digit Span measured a Memory factor in the 18-19 age group 
and a Perceptual Speed in the 25-34 age group. However, as 
indicated earlier, it is difficult to counter this problem and even 
to know whether or not it existed in the present study. Perhaps 
future investigations could include many marker variables for 
the Digit Symbol and Digit Span scales and determine the Per- 
ceptual speed and Memory (Freedom from Distractibility) fac- 
tors more adequately to avoid this situation. 

Another factor matching problem that was experienced in 
the present study was how to match two sets of factors when 
they are in fact different across the groups. The magnitude of 
such a difficulty could be greatly reduced through trial-and- 
error attempts. For example, before any ultimate analyses were 
performed, the present study used a very small eigen value as 
the cutting point and factor analysed the scores on the 24 varia- 
bles in both the groups. These preliminary analyses then retain- 
ed the same number of principal component factors as the 
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number of variables and indicated allthe corresponding eigen 
values. Then the nature of the first fifteen principal component 
factors were grossly examined in both the groups. After an 
observation of the nature of these factors in both the groups 
two eigen values (1.е., 1.02 and 0.95) were used for the final 
analyses. Fortunately, in the present study these two eigen 
values not only approximated Kaiser and Caffrey’s criterion of 
positive generalizability and Cattell's (1966) requirements of the 
scree test, but also retained an equal number of roughly similar 
factors for both (ће groups of the present study. In spite of all 
these considerations, the final analyses resulted in an. Analogy 
factor in the 18-19 age group and a Logical Reasoning factor 
in the 25-34 age group which were rather unique to each of 
the groups. Therefore the psychometric invariance assessment 
of any test owing to the contributions of these two factors were 
not considered to be very conclusive. This was particularly true 
for the Similarities scale that loaded an Analogy factor in the 
18-19 age group and a Logical Reasoning factor in the 25-34 
age group. 

q The major limitations of the present study are associated 
with the sampling procedures. While educational levels and sex 
of the subjects in both within and across the age groups were 
carefully controlled, no adequate step was taken to control the 
socio-economic status of the samples. Besides, the subjects of 
the 18-19 age group were all full-time students whereas the 
Subjects of 25-34 age group were mostly part-time students with 
various professional backgrounds (i.e., pilots, secretaries, sales 
persons, mechanics, school teachers, housewives, etc). The 
heterogeneity of the subjects sampled obviously expands the 
Scope of generalizability of the results. But at the same time it 
is likely that the present age groups were not adequately charac- 
terized which would have been possible had the above factors 
been more carefully controlled. 

ш: has already been pointed out that in the present study the 
ratio of Ше WAIS performance scales to their markers was 
а higher (i.e, 5:9) compared to the WAIS verbal scales to 
e rev ae "s TE Such a situation Scems [0 have helped 

erger і в performance factor (1.е., Spatial Con- 
ceptualization) in both the groups. On the other hand, there 
was not a single relatively strong verbal factor in either ЖІ 
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This was the main reason why no conclusive results were obtain- 
ed with regard to the psychometric invariance of Comprehen- 
sion and Similarities subscales. The future studies should, 
therefore, investigate more carefully sampled age groups and 
include a greater proportion of verbal markers to derive more 
conclusive results. 


CHAPTER V 


Summary 


The purpose of the present study was to assess the psychomet- 
ric invariance of the WAIS subscales across 18-19 and 25-34 
age groups. Such an assessment required the examination of 
Stability of factor loading contents of the WAIS subscales 
across various age groups. 

A review of the related literature suggested that some of the 
WAIS subscales do not meet the requirements of psychometric 
stability particularly across the 18-19 and 25-34 age groups. 
However, these findings are based on the factor analyses of the 
WAIS subscales alone. Therefore several marker variables were 
Proposed to be included in a factor analytic investigation of the 
WAIS for the 18-19 and 25-34 age groups. Psychometric stabi- 
lity of the WAIS across these two age groups was considered 
to be the minimum requirements of these scales being psycho- 
metrically invariant in the entire adult life-span context. 
Further, a cross-sectional strategy was considered to be the only 


appropriate one because the psychometric stability of the 
WAIS were to be examined across the two age groups at а 
point in time, 


A total of 200 subjects (i.e., 100 in each age group) were 
tested in four testing sessions. In the first session all the subjects 
Were tested individually by the WAIS. In the subsequent three 
Sessions the subjects were given all the scales of DAT, CFIT, 
and PM-A in small groups. 

Prior to any essential analyses the raw scores of all the 24 
variables in both the groups were separately factor analysed 


ng a very small cutting point (i.e., 0.01) to obtain principal 
component factors. This 


resulted in 24 principal component 
factors in each of the two groups. The nature of the first 15 
factors of both the £roups was then grossly examined. Finally, 
on the basis of the scree te 


St results, criterion of positive gene: 
ralizability, and the requirements of equal number of similar 


usi 
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factors, two eigen values were selected to retain principal com- 
ponent factors for subsequent Varimax rotations. In the 18-19 
age group the resulting rotated factors were interpreted as 
Spatial Conceptualization, Verbal Relations, Freedom from 
Distractibility, Numerical Manipulations, Perceptual Speed, 
Language Usage, and Analogy. In the 25-34 age group the 
seven rotated factors were interpreted as Spatial Conceptualiza- 
tion, Language Usage, Perceptual Speed, Logical Thinking, 
Memory, Numerical Speed, and Verbal Facility. The factors of 
both the groups were matched in pairs on the basis of their 
similarities. The revised version of Cattell’s pattern correla- 
tions were then computed to determine the stability of psycho- 
metric components of all the WAIS subscales across the age 
groups. 

The principal findings of the present study were as follows : 

1. Considering reliability estimate (rj) as the maximum 
possible total common variance of a test, it was found that the 
total variance of the WAIS (as indexed by А5) were satisfac- 
torily accounted for in the present study. Such a condition 
provided a much needed prerequisite for psychometric inva- 
riance assessments of the WAIS subscales. The general success 
in accounting the total variance of the WAIS was attributed to 
the inclusion of several marker variables in the present study. 

2. Information, Arithmetic, Digit Span, Vocabulary, and 
Block Design scales were found to be psychometrically inva- 
riant across the present age groups. It was suggested that 
these scales should be further examined across other age groups 
in order to establish their psychometric stability across the 
entire adult life-span. 

3. Comprehension, Similariti 


pletion, Picture Arrangement, an 
found to be psychometrically non-invariant across the present 


groups. These findings were interpreted in terms of the develop- 
mental trends of fluid and crystallized intelligence. The implica- 
tions of these results suggested that these subscales are psycho- 
metrically non-invariant or lack psychometric invariance across 
the entire adult life-spau. However, owing to the limitations of 
factor matching procedures no definite conclusions were drawn 
with regard to these apparently psychometrically non-invariant 


scales. 


es, Digit Symbol, Picture Com- 
d Object Assembly scales were 
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4. The results of the invariance analyses indicated that none 
of the WAIS subscales was found to have significantly different 
(distinctly dissimilar) factor loading patterns across the age 
groups because по г, value of the present study was found to 
be negatively significant at an acceptable level. This suggested 
that while certain WAIS were psychometrically invariant and 
certain others were psychometrically non-invariant, none of 
them proved to be psychometrically different across the age 
groups. 

The implications of the present results were mainly related 
to the concepts of test reliability and validity. It was suggested 
that evaluation of psychometric invariance could simultaneously 
examine psychometric reliability and psychometric validity, both 
of which were proposed as more useful and realistic alternatives 


to the traditional reliability and validity assessments of a mea- 
sure. 
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APPBNDIX A 


Cross-Cultural Comparisons of the Factor Loading Patterns of WAIS and 
HOWIE subtests! 


Variable Sample Factor 
A B С р 
Inf G-H? 56 .04 п 44 
A-W3 29 —.09 ES! .10 
Comp G-H .57 —.05 .37 20 
A-W .39 01 .38 —.10 
DSp G-H .14 19 32 .26 
A-W .00 .09 45 .03 
Arith G-H .26 24 .35 23 
A-W .04 .06 .35 .08 
Sim G-H МЕЈ alt —.09 .38 
A-W .42 .10 .10 .02 
Voc G-H 21 ES 407 .43 
A-W —.06 +29 21 .20 
РА G-H .51 .44 —.22 :22 
A-W .30 20 -.09 10 
РС G-H .28 23 —.05 .58 
A-W .07 .04 .01 .38 
BD G-H .26 .50 .07 .43 
A-W .00 .58 .09 .00 
OA G-H .08 .53 —.09 .34 
A-W —.01 156 —.03 03 


1, Riegel and Riegel (1962). 
2. German sample tested by HAWIE. 
3. American sample tested by WAIS. 


APPENDIX B 


Developmental Comparisons of the Factor Loadin 


g Patterns th 
Information Subtest! "s of the WAIS 


Age Group Factor 
Verbal Perceptual Memory 
Comprehension Organization 
18-19 .30 .09 .04 
25-34 21 —.00 10 
45-54 .36 —.05 .10 
60-704- .29 —.09 41 


1. Соћеп (1957). 
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APPENDIX C 
Developmental Comparisons of the Factor Loading Patterns of the WAIS 
Digit Span Subtest! 
Age Group Factor 
Verbal Com- Perceptual Memory 
prehension Organization 
18-19 .50 .05 —.01 
25-34 10 .03 42 
45-54 .08 .09 44 
60-70-- 38 07 .09 
1. Berger et al. (1964). 


APPENDIX D 


Comparison of the 475 and the Reliability Estimates (уу) of WAIS Subscales 


Variable h? Tj 
WAIS WAIS WB WB WAIS — 
(Cohen, (Berger (Davis, (Dermer (Wesch- 
1957) et al., 1956) Aborn & ler, 1958) 

1964) Canton, 
1950) 

18-19 18-19 12-16 18-19 18-19 
Age Age Age Age Age 
Group Group Group Group Group 

Inf 10 .35 .60 .86 .91 

Comp 12 34 .39 174 179 

Arith 2 29 .68 .62 179 

біт .06 .38 48 1 .87 

D Sp .09 27 133 .67 л 

Мос 97 47 .58 .88 .94 

D Sy .03 30 49 .80 92 

РС 01 37 37 .83 .82 

BD ВЕ 37 .65 .84 .86 

РА .09 26 32 64 «66 

OA 43 38 28 .69 .65 


Note :—h?s were calculated from existing studies, 
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APPENDIX Б 


Eigen Values Based оп the Principal Component Solutions 


Factor Eigen Value 
18-19 Age 25-34 Age 
Group Group 

I 5.73 7.58 
II 2.66 2.16 
Ш 2.15 1.69 
IV 1.48 1.24 
у 1.24 1.19 
У 1.16 1.09 
уп 1.05 0.97 
УШ 1.00 0.88 
IX 0.88 0.76 
x 0.86 0.75 
XI 0.77 0.64 
XII 0.62 0.62 
XIII 0.58 0.55 
XIV 0.57 0.53 
Ху 0.52 0.49 
XVI 0.50 0.48 
хуп 0.42 4% 
ХУШ 034 425 
хІх 0.33 637 
Xx 0.32 0.31 
XXI 0.29 029 
XXII 0.20 0.23 
XXIII 0.17 0.20 
ХІУ 0.14 ond 
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Mean and Standard Deviations of Different Scales for the 18-19 and 25-34 


Age Groups 
Variable Variable 18-19 25-34 t 
Number (N = 100) (N = 100) 
X SD X SD 

1 Inf 20.59 3.59 22.05 3.26 3.01** 
2 Comp 19.39 3.63 21.98 2.62 5.78** 

3 Arith 13.39 2.48 13.80 2.64 0.55 

4 Sim 19.20 3.38 19.18 2.90 0.05 

5 DSp 12.36 5:75 11.45 1.96 1.50 

6 Уос 58.78 9.41 65.00 8.53 3.86** 
7 D Sy 64.64 10.16 62.84 10.24 1.25 

8 РС 14.66 4.83 15.06 3.04 0.71 

9 BD 38.58 7.15 39.96 7.79 1.21 
10 PA 24.27 331 Dy 2547 5.76 1.54 
п ОА 33.24 6.47 35.32 5.95 2.36* 
12 VR 35.80 7.06 35.67 8.05 0.12 
13 SR 52.30 20.67 50.69 22.28 0.53 
14 CSA 66.53 13.90 65.58 13.27 0.49 
15 LU-S 72.78 29.65 82.68 15.65 3.94** 
16 LU-G 4449 15.19 45.62 15.35 0.52 
17 NA 32.14 6.26 28.27 9.16 3.49** 
18 AR 40.19 5.08 37.00 8.76 3.16 
19 MR 40.48 12.40 42.76 13.23 1.26 
20 PM-A 23.70 5.33 23.61 4.94 0.12 
21 Ser 8.07 1.42 7.92 4.94 0.73 
22 СІ 7.15 2:22 6.36 2.21 2.52%% 
23 Май 6,25 1.51 5.63 1.76 3,03% 
24 Сопа 5.78 1.52 5.45 1.37 1.61 


Note : Statistics in the table are based on the raw scores, 


* P«.05. 
Ip 0]. 


98 Assessment of Psychometric Invariance of. the. WAIS 


APPENDIX H 


Product-Moment Correlations of the Twenty-four Variables for the 18-19 Age 
Group 


.193 161 -144 
411 -185 417 427 
—.085 129 —.075 .044 


1 2 3 4 5 6 7 5 
1 

2 46 

3 295 1176 

4 308 .395 106 

5 —.041  .046 286  .040 

6 1587 — .580 290  .388 056 

7 -149 —.024 —.076 .008 —.500 119 

8 054 272  .18  .085  .538 111 —219 

9 074 036 .370 117 —.058 096 018 —.148 
10 124 .04  .187 .065 199 050 —034  .208 
1 —093 (012 .059 0026 1052 — 088 — 041  .189 
2 065 — .369 413 245 036 653 E177 191 
13 245 314 .9 274 102 258 —.143  .179 
14 —031 .072 —069 —.004 —.005 —099 314 043 
15 343  .069  .179  .169 —.056 331 364 — 056 
16 397 36 170 .332 —.004 548 190 134 
17 196 —.004 .361 —.036 —094 41 123 — 19 
18 128 .067  .301 —.084 084 189 070 .098 
19 ТАК ОЗЫ 388 Mi Tios бов 91-Е 240 222 
20 ЕР 2577 991 456 7209 —.021 1170 
21 ШО 033 21703 М 105 —.032  .0ll 
22 :224 (М7 221 ! 443 (057 056 —.051 .062 
23 3216 — .00 176 149 20 223 —.051 141 
24 26 ОТЕ 23072 lion те 238 —.085 055 
Е в 
1 

2 

3 

4 

5j 

6 

7 

8 

9 

10 202 

11 .343 142 

12 

13 

14 


—.023 


(Contd.) 
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APPENDIX Н (Contd.) 
9 10 m 12 13 14 15 16 
15 —.045 .030 —.054  .480 .01 .072 
16 103 .062 .14  .694  .348 —.092 476 
17 .224 .081 .121 331 .220 .106 -310 .235 
18 .352 .120 .245 .324 .500 ‚002 .242 .266 
19 .505 193  .346  .337 .572 —.090 —.103 188 
20 .339 .060 .298 .386 .503 .003 .112 .301 
21 .196 -154 .173 .273 .333 —.084 .100 .124 
22 223 1.175 319.303 "1.332 95.304 ' 11.086 1078.181 217 
23 .281 .056 .212 .263 1225 —.080 .119 .246 
24 1283 .083 198  .273  .345 —.073  .006 .249 
17 18 19 20 21 22 23 24 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 413 
19 210 437 
20 .288 .489 418 
21 (2123 2590: 231 4926 
22 380 „231 .173  .423 .298 
23 129 3832 392 .279 279 25 
24 202  .216 .263 223 0054 281 250 
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Product-Moment Correlations of the Twenty-four Variables for the 25-34 Age 
Group 


1 2 3 4 5 6 7 8 

1 

2 266 

3 2152% 4.153 

4 246 .94 .032 

5 —011  .07  .161  .101 

6 513  .313 .266 407 115 

7 —.056 .03 0.203 107 116 080 

8 348 63 4423 21 .082 094 250 

9 "05  .182 34  .177 096 292 .289 .568 

10 322 06 „331 200  .128 зз 123 526 

п 26 129 20 181 180 28 161 .568 

12 АП 235 273 47 237 550 .168 .418 

13 105 .081  .361  .218  .196 150 .180 — .491 

14 48  .107 073  .23 0078 080 .523 239 

15 (80 278  .193 204 194 282  .186 .104 

16 316 — 288  .146 441 з мы 488 — .221 

17 24 — 231 230 287 05 20 ЭЗ 2257 

18 34 22 400 зи 219 293 — 263 .434 

19 489 — .032  .369 044  .066 322 —.033 44 

20 987 .142  .335 337 201 261  .302 .490 

21 3030 оз 186 132 269 — .130 240 .363 

22 446 04 — 345 110 155 493 209 .906 

23 0 10 447 334 іл 21 279 .374 

24 401 220 23 192 1154 4134 193 .488 
9 10 11 12 13 14 15 16 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 471 

11 .535 .376 

12 451 .394 3 

13 4537 .490 481 478 

14 (96 147 02 15 1060 


(Contd.) 
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9 10 11 12 13 14 15 16 
15 —.004 .166 .023 .208 .031 .174 
16 122 321  .231 0457  .336 .091 4461 
17 1280 189  .163  .427 291  .165 129  .228 
18 402 372  .440  .570  .479  .184  .060  .315 
19 413 2340  .253 94 457 —.M0 —.153  .273 
20 417 39 481. 519 .54  .179  .013  .326 
21 331 0221  .424  .302 417 7107 —.106 181 
22 432 321 389 0.396 0428 218  .026 136 
23 409 323 Заз 0464 404  .161  .003 2300 
24 44 34 36 52 47 .274 —020 237 
jr) 18 19 20 21 22 23 24 
M 
2 
3 
4 
S 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 .493 
19 .334 405 
20 .330 .603 2354 
21 190 .413  .283 407 
22 298 .378 274  .371 315 
23 1887 242 43 551 362 395 
24 276 34 206 38 зо 277 206 
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Principal Component Factors for the 18-19 Age Group 


Variable Variable Factor 

Number 1 п ІШ uy У vi УП 
1 Inf 551 —470 158 092 —078 —229 058 
2 Comp 447 —320 454 221 288 —115 —118 
3 Arith 572 114 036 —11 —334 —475 —130 
4 Sim 379 —285 337 236 303 003 352 
5 D Sp 156 365 612 —481 —222 —050 077 
6 Voc 591 —521 333 168 —088 006 —172 
1 D Sy 010 —568 —513 —080 317 035 —159 
8 PC 239 235 565 —465 107 280 —133 
9 BD 488 353 —296 345 110 —265 —095 
10 PA 271 174 089 —338 297 —348 —202 
11 ОА 359 462 —157 045 331 329 157 
12 VR 767 —351 011 —139 —045 098 —097 
13 SR 714 283 025 150 223 057 —056 
14 CSA —041 —155 —160 —497 593 —246 —058 
15 LU-S 359 —570 —242 —342 —222 152 023 
16 LU-G 630 —428 049 —027 —0s9 317 043 
17 NA 446 —005 —519 —256 —224 —233 134 
18 AR 597 223 —317 —132 —132 142 —298 
19 MR 621 429 030 234 071 —038 —303 
20 РМ-А 637 215 —109 —058 087 192 138 
21 Ser 397 148 —273 053 —086 133 —133 
22 Ci 505 142 —240 —235 065 —007 571 
23 Mat 500 161 —033 079 —146 266 —020 
24 Cond 501 096 112 160 —070 —298 398 


Note : Decimal points omitted. 
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APPENDIX K 
Principal Component Factors for the 25-34 Age Group 
Variable Variable Factor 
dumber т dt йй м ~ ҮШТІ 
1 Inf 414 439 —336 —143 —349 —076 340 
2 Comp 314 502 021 —116 —157 -005 390 
3 Arith 527 —099 —021 —083 217 619 079 
4 Sim 445 472 026 314 —068 —302 —054 
5 D Sp 272 —029 248 169 601 —222 389 
6 Voc 558 472 —269 —205 026 —044 176 
7 DSy 353 —024 729 —112 —077 174 —023 
8 PC 739 —099 —061 —427 —106 019 —021 
9 BD 695 —202 —047 —222 —012 —002 —244 
10 PA 615 —016 —194 —358 190 020 —047 
11 ОА 643 —185 050 —290 —063 —336 053 
12 VR 745 221 —109 151 015 —083 196 
13 SR 713 —269 —072 —011 184 —082 —164 
14 CSA 259 153 696 —223 —363 034 159 
15 LU -S 184 645 272 —136 456 222 —094 
16 LU -G 532 474 —020 081 246 —124 —264 
17 NA 518 124 —039 401 —330 283 026 
18 AR 744 —036 027 273 ,—127 067 196 
19 MR 556 —158 —478 109 034 218 —023 
20 PM-A 726 —146 106 198 —042 -095 052 
21 бег 524 —385 150 149 041 -352 049 
22 СІ 571 —238 044 -030 015 130 202 
23 Ма 682 —146 090 347 -017 190 —067 
24 Сопа 572 —236 101 —042 —062 —137 —428 


Note : Decimal points omitted. 
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